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ABSTRACT 

Twenty thi rd-grade teachers and their low ability 
reading group students part icijpated in a naturalistic study to test 
how teachers* explanations during a year of reading instruction 
affected either metacognitive awareness or student use of strategies 
while reading. The 10 teachers in the treatment group were trained to 
be explicit when teaching low ability groups touse reading skills as 
strategies; the remaining 10 served as a control group The first 
group was observed 12 times and the second was observed 6 times. The 
first hypothesis was that treatment teachers would. provide more 
explicit explanations about how to use reading skills as strategies 
than the control teachers. The second hypothesis. was that the 
lowrgroup students of the treatment teachers would demonstrate more 
awareness of _iesson content and of the need to be strategic when 
reading and greater reading achievement gains. Statistically 
significant results confirmed the hypotheses regarding explanation, 
awareness, and achievement; teachers were able to become more 
explicit in explaining reading skills strategies; students did 
respond to theexplanations; and the explana to better 

achievement test scores. These findings indicate that explanation is 
important because it makes students more consciously aware. of the 
content of their lessons^ Also important are the possible linkages 
between explici texpianations , student cognitive processing of 
instructional information^ and ach (References and eight 

appendixes providing the rating criteria and other measures used in 
the study are included.) (SKC) 
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Results of prior research indicate that metacogriitive awareness of 
reading strategies distinguishes good readers from poor readers and that 
such awareness can be taught, it is not known, however, how teachers' 
explanations during reading instruction affect either nietacdgnitive aware- 
ness or student use of strategies when reading. The experiment reported 
hure was designed to study these effects in actual classroom settings. 
Twenty third- grade teachers and their low reading group students partici- 
pated. Teachers were randomly assigned to one of two groups. The 10 
teachers in the treatment' group were trained to be explicit when teaching 
low reading groups to use reading skills as strategies; the remaining 10 
served as a treated control group. Researchers hypothesized first that 
treatment teachers would provide more explicit explanations about how to 
use reading skills as strategies than treated control teachers. They then 
h3rpothesi2ed that the low- group students of the treatment teachers would 
demonstrate (a) more awareness of lesson content and of the need to be 
strategic when reading and (b) greater reading achievement gains as deter- 
mined by traditional and hontraditibnal measures. Statistically signifi- 
cant results confirmed the hypotheses regarding explanation, awareness and 
achievement. The importance of explanation is discussed as well as the 
possible linkages between explicit explanations, student cognitive proces- 
sing of instructional information, and achievement. Implications for 
instructional practice and for future instructional research are suggested. 
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THE EFFECT 0F_PIRECT EXPLANATION OF READING STRATEGIES ON 
LOW- GROUP THIRD GRADERS' AWARENESS AND AGHIEVEMENT: 
A TECHNICAL REPORT OF THE 1984-85 STUDY 

Laura R. Roehler , Gerald G. Duffy, Joyce Putnam, Roy Wesselnian, 

Eva Sivan, Gary Rackliffe, Cassandra Book, Michael Meioth and Linda Vavrus^ 

Research on reading instruction traditionally examines the relation- 
ship between instruction and student achievement as measured by tests. 
Recently, howeve^, scholars have suggested that students cognitiveiy 
mediate instruction, forming a bridge between instruction and achieve- 
ment on tests (Doyle, 1983; Winne, 1985). The study reported here 
is based on this concept and focuses on (a) whether students who receive 
explicit teacher explanations of the mental processes associated with 
using skills as strategies mediate lesson content in ways which result in 
more awareness and (b) whethe^ such explanations are also associated with 
greater student achievement gains. 

Background To This Line Of Research 
This research report, the fourth in a series of studies of teacher 
explanation conducted in each of the academic years between 1981 and 
1985, describes the rationale for this line of research, the similarities 
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across the four studies, the resulti of the first three studies, and the 
distinctive features of this line of instructional research. 

Ra tionale for the Line of Studies 
This research, focused on teaching low-gioup students to use reading 
skills as strategies, is based on recent comprehension -esearch that 
emphasizes the sCC£::egic nature of reading (Brown, 1981; Paris. Lipson. & 
Wixson. 1983; Pressley. Forest-Pressley , Elliot-Faust, & Miller, 1985) and 
the relationship between raetacognitibn and performance (Baker & Brown, 
1984; Flavell & Wellman, 1977). As described by Johnston (1983), "Reading 
comprehension is considered to be a complex behavior which involves con- 
scious and unconscious use of various strategies" (p. 17). Such strategy 
usage requires readefs to be aware of the cognitive activities they engage 
in when reading and to be able to control these activities (Baker & Brown, 
1984). When the conceptual load or the structure of a text is complex and 
comprehension breaks do;m, good readers first become aware of the break- 
down and then control it by using strategies to repair the breakdown and 
to continue reading. 

Pressley (in press) calls these "specific strategies." They include 
"goal specific strategies," such as determining word meaning using context 
clues or drawing conclusions which readers use to understand text; "moni- 
toring strategies," used to keep track of whether text is making sense; 
arid "higher order sequencing strategies" which are plans employing both 
monitoring and goal specific strategies to remove a blockage. Expert 
readers use such specific strategies when the need arises; poor readers do 
not. One of the teacher* s iSportant tasks, then, is to teach students 
(a) the awareness needed to monitor comprehension activities and (b) how 
to control comprehension by engaging in the mental acts associated with 
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using specific strategies to restore meaning. Past ihstructiohal studies 
in reading have not focused on teaching the mental acts of strategic 
reading in this way (Roehler, Duffy, & Meioth; 1986). 

The intent of this line of research was to determine the effect of 
explaining to students the mental processing associated with such strate^ 
gies. Because each student's cognitive mediational activity determines in 
large part what is attended to, interpreted, acted upon, constructed, and 
transformed (Shulman, 1986), it was hypothesized that the development of 
strategic readers may well depend upon whether teachers' explanations 
cause students to understand accurately the instructional content about 
what cognitive processing to employ when using a particular strategy. 
This may be particularly true of low- group students in reading who, be- 
cause they tend to have relatively less knowledge of the world generally 
and of language and how it works particularly, are less able than high- 
group students to infer from generalized instructional activities that 
they should be strategic, when it is appropriate to be strategic, and how 
one reasons when being strategic. Consequently, the rationale of the 
study was that low reading group students would be more aware of their 
cognitive processing when using reading strategies and would employ such 
processing when using strategies if instruction were organized and pre- 
sented explicitly, because explicit explanations are more likely (a) to 
increase students' conscious awareness of what is being taught, when to 
use it, and how to do it, (b) to expedite student mediation of instruc- 
tion, (c) tc result in accurate awareness of lesson content, and (d) to 
ensure that strategies are. applied when reading text. 
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S^imllarltles Across All Four StUdies 
Prior to the study reported here, 4 second-grade teachers partici- 
pated in a pilot study in 1901-82, 22 fifth-grade teachers were studied in 
a 3 982-33 classroom-based experiment, and 7 of those teachers were in- 
volved again in a 1983-84 descriptive study. A number of similarities 
across all the studies were found. First, each study focused on three 
questions: (a) Gan teachers explicitly present information about how to 
use reading skills strategically? (b) Are such teachers more successful 
in increasing low-group students' awareness of lesson content than teachers 
who are less explicit? and (c) Are such teachers more successful in in- 
creasing low- group students* heading achievement than teachers who explain 
less explicitly? In all studies, explanations consisted of teacher- 
developed modifications of basal textbook directives, not researcher- 
prepared scripts for teachers to follow. 

The subjects were also similar in all four studies. First, the 
students were all in low reading groups. Second, the teachers volunteered 
to participate and, in the latter th^ee studies, all the teachers taught 
in various schools in a midwest urban school district where a busing 
policy distributed studentn equally among all schools in terms of socio- 
economic status and ethnic background. In all the studies the training 
for treatment teachers focused on making students consciously aware of the 
mental processing involved in using skills as strategies. 

Third, the data collection procedures were similar in all four 
studies. Because ecological validity is essential to ensure that results 
can be applied to practice, all four studies were conducted in the natural 
environment of real classrooms where the teachers used mandated basal 
reading textbooks. Within this context researchers observed all teachers 
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teaching baial text-based skills to low ieidiSi groups at about one -month 
intervals daring the academic year. TreatieHt teachers, however, received 
training designed to improve the explicitness with which they explained 
the mental acts associated with using skills as strategies. Control 
teachers received either no training or training only in the use of class = 
room management techniques. During classroom observations researchers 
monitored student engagement rates, audiotaped the lessons, and recorded 
field notes on the teachers' explanations and other lesson events. Imme- 
diately following each lesson, researchers interviewed several low- group 
students to determina their awareness of lesson content. Three awareness 
questions were asked: What did you learn today? When will you use it? 
How do you do it? Student achievement growth was determined using tradi- 
tional standardized reading achievement tests; in the last two studies, 
these measures were supplemented by nontraditional measures. 

Results of the Three EarLi^ 



The pilot study findings in 1981-82 were encouraging (Duffy, Roehler, 
Book, & Wesselman, 1983). In the 1982-83 classroom-based experiment, 
however, the results of the three Research '.Uv^stion^ Were mixed (Dufiy, 
Roehler, et al., 1986). Treatment teachers were significantly more 
explicit in their explanations about how to use skills as strategies thaS 
control group teachers; and the treatment teachers' low- group students 
were significantly more aware of lesson content than their control group 
counterDarts. There were, however, no significant differences in student 
achievement gains on the comprehension subtest of the Gates HacGinitie 
Reading Test. In short, the hypothesis that explicit explanations 
re.sulted in increased student awareness of lesison content was confirmed. 



5 

9 



but there was no associated increase in achievement on a traditional 
standardized reading test. 

Post hoc analysis suggested several reasons for the lack of signifi- 
cant differenciBis in achievement growth. Most of these focused on the 
limitations inherent in using only standardized tests to assess achieve- 
ment (Johnston, 1983; Paris, Cross, & Lipson, 1984; Roehler, Duffy, et 
al., 1986). Gonsequently, rissearchers developed several nontraditional 
measures of the students' use of skills as strategies. These were field 
tested in the 1983-84 descriptive study (Roehler, Duffy, et al., 1985). 
The first was a set of paper-and- pencil measures of the particular skills 
being taught; the second was an adaptation of the basal text's end-of-unit 
test; and the third was a measure of the student's .strategy usage while 
reading Graded Oral Reading Paragraphs. In addition, the achievement test 
used by the host school district was us^d as the standardized achievement 
measure to limit the testing burden on students. These changes were 
subsequently incorporated into the present study. The results from that 
fourth study constitute the focus of this report. 

Distinctive Features of This tine of Research 
Although this line of research shares much with studies in the direct 
instruction tradition as well as with recent research in comprehension 
instruction, it is distinct from both because it focuses on informing 
students of the mental acts involved in strategic reading. Neither the 
research on direct instruction nor the research on comprehension instruc- 
tion emphasizes this. Instead, direct instruction emphasizes the employ- 
ment of specific teacher behaviors to increase student time on task or 
student attending behavior. As illustrated by recorainendations from 
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exemplary direct instruction work such as the Pirst-Grade Reading Study 
(Anderson. Evertson, & Brophy. 1979) and Madeline Hunter* s program 
(Hunter, 1976), as well as the irecommendatibns of reviewers (Gersten & 
Garnine, 1986; Rosenshine, 1986), little emphasis is placed on explicit 
teacher statements about the mental acts involved in doing the task; 

Similarly, recent comprehension instruction research emphasizes 
activities which encourage, but do not explicitly explain, those mental 
acts. For instance, Au (1979) and Gaiiimore and Tharp (1983) of the 
Kamehameha Project recommend question asking that helps students associate 
their background experience with story content, but the researchers do not 
explain to students how to make such associations. Also, Hansen and 
Pearson (1983) use a Weaving analogy to illustrate that inferencing is a 
process of integrating old knowledge with new knowledge, but they do not 
have teachers explain to students the reasoning involved in integrating 
knowledge. Similarly, Paris and his colleagues (Paris, Cross, & Lipson, 
1984) and Paiincsar and hers (Palincsar, in press; Palincsar & Brown, 1984; 
1986), while clearly intending to develop mental processes involved in 
being strategic, provide no concrete examples or descriptions of what 
teachers say to students about the mental acts engaged in by strategic 
readers . 

Like earlier process -product researchers such as Good and Grouws 
(1979) and Anderson, Evertson, and Brophy (1979), Paris and Palinscar and 
their colleagues note the iirportance of explanation hut provide nO de- 
scriptions of teachers' explanations of mental processing. For instance, 
the instructional diaicgues cited by Palincsar (in press) focus on get- 
ting students to use the strategy, not on explaining to students the 
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thinking process one employs while doing the strategy. In sum, both the 
direct instruction research and the cbmpriBhension instruction research 
leaves students to infer 'What thinking processes they should engage iii 
while performing the tasks. In the line of research reported here, in 
contrast, the focus is on making the underlying mental acts o^plicit for 
low- group students so that they need not infer them, thereby empowering 
them to perform the strategy on their own. 

This line of research is also distinctive methodologically, partic- 
ul arly when compared to the studies in comprehension instruction. In most 
of those studies, the content taught to students is an adjunct curriculum 
that is provided for a one- or two-month period (usually by a researcher 
or, occasionally, by teachers who follow very directive scripts provided 
by the researchers). The studies reported here, in contrast, use the 
school districts* adopted reading materials for an entire academic year, 
with the regular classroom teachers making individual lesson plans for 
teaching the curricular outcome. This is both a strength and a weakness. 
The ecological validity of the study is high; however, the natural class- 
room environment leaves some variables uncontrolled. 

The Problem 

The study reported here was the fourth in the series and was conduc- 
ted during the 1984-85 academic year. Similar to earlier studies, it was 
designed to determine whether classroom teachers of low- group students who 
provide explicit explanations of how to reason when using reading skills 
strategically would be more effective in producing student awareness both 
of lesson content and of the general need to be strategic and in increas- 
ing reading achievement on both traditional and nontraditional measures. 
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in addition, we conducted an exploratory investigation to determine whe- 
ther explicit teacher explanations would improve student perceptions of 
themselves as readers. We posed four reisearch questions: 

1. Can teachers learn to be more explicit in explaining how to 
use basal text skills as strategies? 

2. Are explicit teacher explanations associated with low-grbUp 
students' awareness of both lesson content and the need to be 
strategic? 

3. Are explicit teacher explanations associated with low-group 
students' more conscious use of skills as strategies and, 
ultimately, with greater reading achievement? 

4. Are explicit teacher explanations associated with improved 
low- group student perceptions of themselves as readers? 

Method 

The method section includes six major subsections: the subjects, the 
curricular emphasis, the interventions with teachers, the measures, the 
general procedures, and the ways in which student engagement rates were 
documented. 

Subjects 

The subjects of the study were (a) 19 third- grade teachers employed 
by an urban school district in the Midwest and 1 third- grade teacher em- 
ployed by a neighboring suburban school district, each of whom was ran- 
domly assigned to treatment and treated control groups and (b) the stu- 
dents in these 20 teachers' low reading groups. Table 1 shows the number 
of students in the low reading groups in the 20 classrooms. Group size 
varied from a low of 3 to a high of 16, with the average group size being 
7.4. 

All teachers met two criteria. First, they volunteered in response 
to a general invitation extended to all third- grade teachers in the urban 
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Table 1 



Niiriber of Low-Group Students in Each Classroom 



TREATMENT TREATED CONTROL 

# of Students Basal Texts Used^ t e ach e r # of Students Basal Texts Used 
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Durr, W.K., LePere, J.H., Pikulski, J.J., & Brown, R.H. (1983), Towers . Boston: Houghton Mifflin. 



district during ths previous spring and summer. Second, they were sched- 
uled by the district to initiate instruction with one reading group in 
either the Skylights (Darr, LePere , & Pikulski, 19835 texts or Towers 
(Durr, LePere, Pikulski, & Brown, 1983b) text (second-grade difficulty) of 
the Houghton Mifflin basal reading series. The latter criterion served to 
ensure that the low groups in all the classrooms were reading at approxi 
mately the same level when the study started in September. The basal texts 
the teachers used with their low groups throughout the academic year are 
included in Table 1. 

Originally, all 20 volunteer teachers were from the urban school dis- 
trict, with a neighboring suburban teacher serving as an alternate. When 
one of the urban teachers in the treatment group became seriously ill in 
mid- September , she was replaced by the suburban teacher: The 20 treatment 
and treated control subjects received modest renumeration for participating. 

The Curricular Emphasis 
The instructional focus was on reading skills and, more specifically, 
on the mental processing expert readers presumably employ when using 
skills as strategies. Consequently, the content of instruction did not 
focus on skills in the traditional sense of rules and procedures to be 
memorized but rather on the reasoning one employs when using skills 
strategically. 

As described in the next section, treatment teachers were shown how 
to make two kinds of decisions. First, because the basal textbook pre- 
scribed isolated skills to be taught as topics or memorized procedures, 
teachers were taught to make a set of decisions about how to recast the 
prescribed skills as problem- solving strategies. Second, because the 
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basal textbook's su^ieitions about what teachers should say when teaching 
the skill tended to emphasise skills as automatized prSceda^ei , ihe teach- 
ers were taught to make decisions about what to say about the mental pro- 
cessing one employs when using skills as problem^ solving strategies: 

To illustrate, assume the basal textbook prescribed the teaching of 
coipound words as a reading skill and that the task emphasis in the basal 
text was on drawing a line between the two words making up the compound 
and then saying the Word. The treatment teachers in this study were 
taught to recast that task as a problem- solving strategy by (a) estab- 
lishing an actual reading situation in which an unknown compound word 
would be encountered, (b) teaching students to stop reading when they re- 
cognize that an unknown word poses a problem, (c) showing them how to 
search their repetoire of strategies for a strategy useful in solving the 
problem of identifying the unknown word, and (d) showing them how to rea: 
son when using the strategy to figure out the unknown compound word. The 
latter two steps (searching and reasoning) were the essence of the mental 
processing students were taught to use. For instance, for compound words 
teachers' explanations would include frequent references io (a) what the 
nature of the meaning-getting problem was in that situation and the kinds 
of skills that might be used to remove the blockage and (b) statements 
about how to look for word parts, how to recognize them as words, how to 
combine the meaning of the two words, and how to check to see if the com- 
bined meaning makes sense in the text. 

The teachers were not provided With a script for teaching the skills 
this way. Instead, each teacher developed his/her own explanations about 
the mental processing associated with the skill being taught based on the 
above principles. Because individuals all process information in unique 
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ways, teachers were taught to preseSt their explanations of cognitive 
processing as descriptive of what g8od readers do, rather than as pre- 
scriptions, and were taught to encourage students to make appropriate 
individual modifications. 

The Interventions With Teachers 
Interventions were provided for both the treatment and the treated 
control teachers. Both groups attended separate orientation meetings held 
during the first week of school in August. At these meetings, the teach^ 
ers in each group were introduced to the project and provided with an over 
view of thei^ respective treatments. Neither group knew about the exis- 
tence of the other, and both believed they were the only experimental 
group. All subsequent sessions v.'ith teachers occurred after baseline data 
were collected. 

The intervention for the treated control jroup consisted of two 2- 
hour group sessions during the fall which focuseC on the use of management 
principles from the First-Grade Reading Group Study (Anderson, Evertson, & 
Brophy, 1979). llie group was told that the purpose of the study was to 
validate the original findings at the third- grade level. The intervention 
training followed precisely that employed by the original researchers. 
Additionally, a maintenance session (not provided in the original study) 
was held in January to allow teachers to review the management principles 
and to discuss their implementation of these principles. The treated 
control teachers also received additional informal coaching from research- 
ers following observations. The management principles are listed in 
Appendix A. 
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The intervention for the treatment group consisted of six a^hour 
training sessions ^ one each in the months of September, October, November, 
January, February, ind April. The information presented in these sessions 
emphasized (a) how to present prescribed basal text skills as strategies 
as described above; (b) how to make explicit statements about the strategy 
being taught, when it would be used, and how to do the mental processing 
involved in using it strategically; and (c) how to organize these state- 
ments into a lesson format that progressed from an introduction, to mod= 
eling, to interaction between teacher and students, to closure. Many of 
the staff development techniques developed in earlier studies were used, 
including procedures for one-on-one coaching, collaborative sharing among 
the teachers, providing specific feedback regarding observed lessons, and 
the use of videotapes. For greater detail on the staff development model 
undergirding the intervention with treatment teachers, see Putnam, Roehler, 
and Duffy (198?) . 

In addition to the above training, teachers in the treatment group 
also received the same r-eport of the First-Grade Reading Group Study 
(Anderson, Evertson, & B^ophy, 1979) that the treated control teachers; 
used and, like the treated control teachers, they were urged to incor- 
porate the management principles into their reading instruction. Research- 
ers monitored the treatment teachers' use of these principles during the 
academic year just as they did with the treated control teachers. 

While the two interventions were distinctive in terms of their 
riBspective content emphasis, both the treatment and the treated control 
teachers received identical instruction from researchers in some areas. 
In addition to the management principles noted above, both groups of 
teachers received identical information on (a) how to implement 



Uninterrupted Sustained Silent Reading a-^ part of a classroom reading pro- 
gram, (b) the effects of such a program, arid (c) the benefits of employing 
it. This was done to increase the likelihood that skill instruction in 
both treatment and treated control classrooms would occur in a context 
that encouraged genuine literacy events, such as self -selected reading for 
enjoyment. Similarly, to increase the likelihood of equal test-taking 
skills by students in both groups during the posjttest administration of 
::he achievement test^ in March of the year of the study both the treatment 
teachers and the treated control teachers received identical printed sug- 
geistioris about how to prepare students to take a standardized reading 
test, discussed the implementation of these with researchers, and agreed to 
present them to their students. • 

Measures 

This four-part section describes each type of measure used in the 
study: a measure of the explicitness of the teachers* explanations, mea- 
sures of student awa^reness, measures of student achievement, and measures 
of student self -perceptions . 

The Measure of Teacher Explanation 

To measure the explicitnisss of the explanations of treatment and 
treated control teachers, a rating instrument was used to rate audiotaped 
transcripts of tearhers' lessons. Tliis instrument, similar in many ways 
to the instrument used in previous studies (Duffy, Roehler, et al. , 1986), 
was modified for this study to reflect recent findings from the earlier 
studies regarding specific characteristics of teacher explanation 
(Rackliffe, 1986). The modified instrument was organized into three parts 
to reflect three aspects of explanation: the information presented, the 
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means u-^ed to present it, and cohesion. Each part included subcategories, 
with a total of 11 subcategories rated. A copy of the rating instrument 
is provided in Appendix B. 

Part I of the rating instrument, the information presented, focused 
on what teachers told students about (a) the task to be learned, (b) the 
usefulness of the task, (c) the selection of the strategy to be used, and 
(d) how to perform the strategy. Part ii, the means used to present 
information, focused on the teacher's (a) introduction to the lesson, 
(b) modeling, (c) diminishing assistance during interaction, (d) eliciting 
of student responses, and (e) closure. Part III, cohesion, focused on the 
cohesion within the lesson and cohesion with past and future lessons. 
Each of the 11 subcategories was rated on an explicitness scale of 0 to 4 
(with 0 being the absence of the criterion and 4 being an exemplary pre- 
sence of the criterion). The maximum obtainable explanation score was 44 
points . 

The typed transcripts of teachers' lessons were rated by raters 
trained to use the explanation rating form. Raters were graduate students 
majoring in teacher education at Michigan State University. Six raters 
were paired into three teams of two raters each. The training of ratters 
consisted of a series of five 1- to 2-hour sessions conducted by research- 
ers. Lesson transcripts selected from those collected during the 1982-83 
and 1983-84 studies werie used for training. 

As part of this training, researchers gave raters general information 
about the structure and goals of the study arid their role as raters. Then 
researchers used a videotaped lesson and sample lesson transcripts to 
model how to rate lesson transcripts. Researchers then gave raters 
successive opportunities to practice rating additional sample transcripts. 
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All raters rated identical transcripti daring training to ensure inter- 
rate^ Reliability across all six raters; As part of the training, raters 
developed conventions to guide their rating. When the rating teams 
achieved an inter-rater reliability of .80, the actual rating of lesson 
transcripts from this study began. Researchers periodically met with 
raters during the academic year and provided feedback and conducted dis- 
cussions to clarify any ambiguities that may have arisen. 

Lesson transcripts were rated in a series of "rating iSunds." For 
each round, each rating team received a packet of 10-15 transcripts to 
rate. Twenty : five percent of all the transcripts in each packet were 
rated by all three rating teams to monitor inter-rater reliability. On- 
going inter-rater reliability both within pairs and across pairs was 
computed on these commonly rated transcripts following each rating round. 
To maintain the .80 criterion for acceptable inter-rater reliability, 
researchers provided supplemental training for raters as needed. The 
average reliability for the rating teams across the academic year was .81. 

Raters used the following procedures when rating lesson transcripts. 
First, each rater independently read and rated all transcripcs in the 
packet. These ratings were recorded on an individual summary sheet. 
Second, each rater conferred with his/her rating partner, compared as- 
signed ratings for each rated category of explanation and reconciled any 
differences in scores to arrive at a single team score for each lesson. 
Third, each team submitted its jointly determined scores as final ratings. 

The Two Me asures bi Student Awareness 

Student awareness was measured in two ways. Awareness of lesson 
content was determined using postlesson interviews (hereinafter called the 
"lesson interviews"). Awareness of the need to be strategic when reading 
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was evaluated using an interview given at mid-year and at the end of the 
year (hereinafter called the "concept interviews"). 

The lesson interviews. The lesson iriteirviews were used to determine 
whether students were consciously aware of what the teacher was teaching 
during individual lessons. To determine whether low-group students pos- 
sessed such awareness of lesson content, researchers interviewed five 
students in each of the treatment and treated control classrooms imme- 
diately following each observed reading lesson regarding their declarative 
knowledge (what they were learning) , their situational knowledge (when 
they should use it) , and their procedural knowledge (how they should use 
it) as in Paris, Lipson, and Wixson, 1983. Three of the students were 
target students who were selected at random before the first observation 
and interviewed after every observed lesson; the other two students Were 
randomly selected for each interview from the balance of students in the 
low group. If a target student was absent of moved away during the study, 
another student from the low group was randomly selected to complete the 
complement of five interviewees. Six interviewers (faculty members and 
advanced graduate students), each of whom was responsible for both lesson 
observation and interviews in designated classrooms, were trained to 
conduct the interviews in that classroom and to probe responses without 
leading students. 

Three levels of questions were posed. At the first level, the stu- 
dent was simply asked to tell all that could be remembered about the 
lesson. ThiB second level consisted of three questions: (a) What were you 
learning in the lesson I just saw? (b) Iftien would you use what the teacher 
was teaching you? and (c) How do you do what you were taught to do? The 
third level was a repetition of the second level but the questions were 

, 18 23 



asked using examples of the lesisbn content (e.g., worksheets or text 
examples used by the teacher in the actual lesson) . The basic question^ 
were supplemented by a list of additional probes that interviewers could 
US3 if needed. The "how" question waiS asked of all students at the ;:hree 
levels. On the basis of student answers at jirior levels, interviewers 
decided whether to ask the "what" Rxid "when" questions again. 

The data consisted of typed transcripts of audiotape recordings of 
the student interviews. Students' Responses were rated using an instru- 
ment developed and used in previous studies (Duffy, Rbehler, et al. . 
1986): It consisted of categories for bating the students' verbal state- 
ments about (a) what strategy was taught (declarative knowledge), (b) the 
context or situation in which the strategy should he used or applied 
(situational knowledge), and (c) how one employs the strategy (procedural 
knowledge) : Each criterion received a rating of 0 to 4 depending on uhe 
depth and completeness of the student's response, with a score of 0 being 
an absence of awareness and a score of 4 being exemplary awareness. 
Scores for the three categories Were summed. The highest possible score 
was 12. A copy of the rating criteria is included in Appendix G: 

Transcripts of student interviews, like the transcripts of teacher's 
lessons, were rated in rounds by raters trained in the use of the rating 
instrument. Two 2-member teams rated student interviews. The selection 
of raters, their training, the ongoing procedures for maintaining reli- 
ability, and the computation of inter-rater reliability were the same as 
that used for the rating of teacher explanation. The average reliability 
for the student awareness rating teams across the academic year was .84; 
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To rate this ihtisrviews , the following procedures were used. First, 
raters identified where in the transcript the Level 1 question began and 
ended. This response was then rated for each of three specific categories 
(a) declarative knowledge , (b) situational knowledge, and (c) procedural 
knowledge. This same procedure was used for Level 2 and Level 3 re- 
sponses, if a question was not asked at Level 2 because the interviewer 
believed the information had been provided by the student at the first 
level, the category was given the same score as was assigned for Level 1. 
For example, if a response of four was given for declarative knowledge at 
Level 1 and this question was not asked at Level 2, the student received a 
rating of four at the second level. There are three benefits of using 
this scoring system. To illustrate, assume that Student A responded in 
the following manner: 

Level 1: What - 4, Why - 2, How - 1 
Level 2: What - N/A, Why ^ 3, How « 1 
Level 3: What - N/A, Why - 4, How - 3 

Overall Total - 11 (sum of the highest rating in each category 
across levels) . 

First, this scoring system offered the student ample opportunity to 
respond to interview questions. Second, redundancy in question asking in 
Level 2 and 3 were eliminated, thus reducing the possibility that a re- 
peated question might signal to the student that the previous response was 
hot appropriate. Third, it allowed for a more in-depth, post hoc examin- 
ation of the extent to which the student was aware of lesson content. in 
the above example, for instance, Student A gave an in-depth description of 
what the lesson was about at Level 1. However, the student's description 
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of how to use what was taught resulted only after focusing the student on 
the materials used during the lesson (Level 3) . 

The concept in terviews: The second measure of student awarenesi ; the 
concept interview, was used to determine if explicitness about strategic 
use of skills resulted in global student conceptual understandings about 
reading. To assess this outcome, the three target students randomly 
selected from each teacher's low reading group at the beginning of the 
study were asked the questions on the concept interview on two occasions, 
one at the midpoint of the acadercic year and one at the end of the year. 
There was no baseline measure because the interview format had not yet 
been developed when baseline data were collected early in the school year. 

During the concept interviews researchers asked four general questions 
about the student's concept of reading and what one does when encountering 
a situation where text comprehension is disrupted: (a) What do good read- 
ers do? (b) What is the first thing you do when you are given a story 
to read? (c) What do you do when you come to a word that you do not 
know? (d) What do you do when you come upon a sentence or story you do 
not understand? Analysis of responses to these questions provided in- 
sight into students' conceptual understandings about reading, particu- 
ly the need to be strategic and their ability to control meaning getting 
through the application of strategies. 

The Six Measures of Student Achievement 

Student achievement was measured in six ways. The two traditional 
standardized measures used Were the Stanford Achievement Test (SAT) and 
the Michigan Educational Assessment Program (MEAP) . Nontraditional mea- 
sures included a paper-and-pencil skills test (hereinafter called the 
Supplemental Achievement Measure or SAM), an Error Detection Test (EDT) , 
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and a modified Graded Oral Reading Paragraph (GORP) . Additionally, stu- 
dents' scores on the unit skills tests given by teachers as part of the 
mandated basal reading program were noted (Magazine Test). 

The Stan f ord- Achievem e nt Test . The first traditional measure of stu- 
dent achievement was the reading portion of the Stanford .-chievement Test. 
The SAT was mandated for Use in the host school district and included two 
subtests, word study and comprehension. The school district administers 
the test to ail students in late spring of each academic year. For the 
purposes of this study, the scores received by each third-grade low-group 
student in the treatment group and treated control group in April of the 
second-grade year served as the pretest; the scores each of these stu- 
dents received in Ap^ii of the third-grade year served as the posttest. 

The Michigan Educ ational Assessment Prdgram . The second traditional 
measure of student achieveient was the Michigan Educational Assessment 
Program. It is administered in October of each academic year to all 
fourth- seventh- and tenth-grade students in Michigan. Since students in 
this study were third graders, this test was used when they became fourth 
graders to determine what achievement differences might exist among par- 
ticipating low-group students in October of the academic year following 
the end of the study. This test measures both reading and math, but only 
reading scores were used for this study. The reading section of the MEAP 
consists of 75 items that measure student performance in vocabulary, 
literal comprehension, inferential comprehension, critical reading, and 
study skills. 

The Supplemental Achievement Measure : The first nontraditibnal mea- 
sure was the Supplemental Achievement Measure. It was written and de- 
signed by the researchers to determine (a) whether students could perform 
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the specific sskill tasks for which they received instruction, and (b) whe 
ther they were consciously aware of their reasoning when they used the 
siciii. it was expected that explicit explanations of the mental proces- 
sing involved in using skills as strategies would cause treatment student 
to perform particularly well on the second part of the test. 

Part I tested student ability to do the skill task. For instance, 
when the basal textbook prescribed a skill labeled "multi -meaning words," 
students were given the following task after instruction was completed: 

Researcher _reads directions orally: Read the following sentence 
to yourself, _ Pay attention to the underlined word. Look up when 
you are finished. 

Tom went to the park to fly his kite. 

[Student reads sentence] 

Researcher reads directions orally: Now read the nexttwo sen- 
tences to yourselves. Put an X before the sentence where the 
underlined word means the same as in the numbered sentence. 

1. The batter hit a flj ball to the pitcher. 

2. Jim likes to f iy airplanes for a hobby. 
[Student marks the answer] 

Part II assessed students' awareness of their reasoning about how to 
use the skill. For instance, the second part of the Supplemental Achieve- 
ment Measure on multi-meaning words was as follows: 

Researchier reads directions orally: I am_ going to read a ques- 
tion and some possible answers. Choose the best answer. Put 
an X before your answer. 

How did you choose the sentence where "fly" meant the same as it 
did in this firsft sentence? 

I looked at the words around the V7ord_ "fly." They 
hielped me figure but the meaning of the word. 

I read the sentences to see if they had question 

marks or periods and that helped me decide. 
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I thought about what should happen next. That helped 

me find the word that made sense. 

[Student marks answer] 

The skills tested with the SAM test were the same skills tested by the 
basal program's Magazine Tests, which are the criterion-based tests that 
accompany the Houghton Mifflin basal series used by all teachers in the 
study. Fifteen different skills were tested in association with thiB 
Skyltghts basal text (Durr, LePere, & Pikulski, 1983), 10 skills tested in 
association with the Towers text (Durr, LePere, Pikulski, & Brown, 1983b) 
and 15 in association with Spinners (Durr, tePere, Pikulski, Brown, 1983a), 
the first third-grade book in the Houghton Mifflin series, which some low 
group students were using by the end of the academic year. The complete 
list of skill tests created is provided in Appendix D. 

The researchers assigned to observe in particular classrooms admin- 
istered the SAM tests for the skills prescribed in the basal uhit(s) most 
recently taught by the teacher. Testing was done three times during the 
year. The skills to be tested during any one test administration depended 
oh which basal text the group started with in September and on what skills 
the teacher had taught since the previous administration of the SAMs . The 
number of skill tests administered to any one group of students ranged 
from a low of 3 to a high of 18, with the average being 7. The average 
number of SAM tests taken per student across the year was 21. The average 
administration time for each testing session was 20 minutes. All three 
low- group target students took the test together in a location outside the 
classroom. The researcher read verbatim the directions for the test 
administration, as noted in the examples above. 

The Error Detection Test . The Error Detection Test (EDT) was adapted 
from an earlier study reported by Paris, Cross, and Lipson (1984). It 



consisted of a paragraph in which semantic and syntactic errors were em- 
bedded. Students were directed to underline the places in the paragraph 
that did not make sense. A copy of the paragraph appears in Appendix E. 
The same paragraph was adininisterisd in September and again in May to the 
low- group students in each treatment and treated control classroom. 

The Modified Graded Oral Reading Bara.g^#h . The third nontraditional 
achievement measure was a modification of the Graded Oral Reading Para- 
graph test used by reading specialists when diagnosing student needs. The 
GDRP was designed to determine whether students actually used strategies 
when reading text. Specifically, the GORP was designed to determine, 
through self-report data, student use of word recognition and word meaning 
strategies when encountering previously designated embedded words and when 
spontaneously self -correcting . The three randomly chosen target children 
selected before the study began were tested on a passage in September and 
again in May. The third-grade passage from Houghton Mifflin's Placement 
Test was selected because (a) the Houghton Mifflin program was used in all 
elementary grades in the host school district, (b) none of the students in 
the study had previously read the passage, and (c) the content of the 
paragraph offered opportunities to observe student response to semantic 
cueing (Wixson & Lipson, 1986) and student self -corrections of spontaneous 
errors (Clay, 1972). Project researchers, based on their previous expe- 
rience as reading specialists, judged this paragraph to be of sufficient 
difficulty to elicit self -corrections but not too difficult to cause ex- 
treme frustration for third- grade low-group readers. A copy of the pas- 
sage is included in Appendix F. 

Three researchers were trained as testers. For both the pretest and 
the posttest they administered the 30-minute test individually to each 
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target student in a room other than the classroom. Each student's per- 
formance was tape recorded for subsequent analysis. 

Each testing session proceeded as follows. A preliminary test of 
sight word recognition involving 30 words (provided by Houghton Mifflin as 
part of the test) preceded the actual reading of the GORP and served as a 
warm-up activity. Then the student was shown the first of two predeter- 
mined target words embedded in the text ("grub"). The student was asked 
to pronounce the word and use it in an original sentence. It was antici- 
pated that the meaning as used in the paragraph (a type of insect) would 
be initially unknown to most of these low- group third graders. If the 
word was mispronounced by the student, the correct pronunciation was pro- 
vided by the researcher. The second embedded target word ("uncovered") 
was pointed out to the students following the reading to determine their 
use of prefixes as a strategy. 

The student was then given a copy of the selection and was asked to 
read it aloud and to remember what was read so that it could be retold 
after the reading. Students were reassured that they might not read the 
entire story, but that they should read as far as possible. It was im- 
portant that all students at least read past the point at which the tar- 
get words- "£rub" and "uncovered" were introduced Into the narrative. The 
decision to stop the reading at a point beyond these words was based on 
tester discretion given the perceived level of difficulty for the* student. 
As the student read, the researcher recorded instances of self -corrections 
arid hesitations. At the end of the reading, the student's copy was re- 
moved and s/he was asked to retell all that could be remembered about what 
had just been read. 
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Student self-report information about the use of strategies while 
reading the passage was elicited after the retelling. The tester selected 
examples of self -corrections noted during this oral reading of the seiec- 
tibn and asked the student v/hy s/he made a particular self -correction and 
how the self-correction was accomplished. Each student's verbatim re- 
sponses were audiotaped, and there were 2 to 5 examples of self -corrections 
for each student. The tester then asked students about the embedded words. 

First, students were asked whether they now knew the meaning of 
"grub" and, if so, how this meaning was determined (since it was unknown 
before reading the passage). Then the student was asked to explain how to 
figure out the word "uncovered." This ended the testing session for each 
student. The primary intent was to assess students* use of strategies by 
examining their self -reports of (a) thejr self -corrections and (b) their 
responses to the two embedded words. 

Maga ^4 ne Tests . The students* scores on the above-mentioned Magazine 
Tests were also recorded. As noted above, these were the end-bf-unit 
tests associated with the Houghton Mifflin basal text program that the 
teachers administered and recorded as part of their regular routine. 
These data were then collected for Use in this study because the students 
in both the treatment and treated control groups were using basals from 
similar levels in the same series and were ^ therefore, taking the sama 
unit tests. A sample Magazine Test is included in Appendix G. 

Two self -perception measures were designed to assess students* 
perceptions about their reading achievement and about the amount of 
reading they did. Researchers administered each measure individually in 



27 3 2 



September arid again in May to the same three randomly selected target 
students from each treatment and treated control classroom. 

^^eeiv^- place inr the reading group . The first self -perception 
measure was a pre/pbsttest measure of studerits' perceptions of their place 
in the reading group, adapted from a measure used by Weinstein (1980). 
The interviewisr presented each student with a scale designed as a ladder, 
which students were told reprissented the reading group. The persons on 
the top rungs represented high reading group achievers and the persons on 
the bottom rungs represented low reading group achievers. The student was 
instructed to place him- or herself on the rung of the ladder which rep- 
resented his or her perceived place in the reading group. 

Perceived amount of reading . Researchers also adminiistered the second 
measure individually on a pretest/posttest basis to the randomly selected 
target students. Each student was shown two pictures, one of a house and 
three different- sized piles of books and another of a school and three 
different- sized piles of books. The interviewer directed each student to 
draw a line first from the house to the pile of books that best represented 
the amount of reading done at home and then from the school to the pile of 
books which represented the amount of reading done at school. The measure 
is provided in Appendix H. 

Summary of the Measures Used 

To determine whether explicit teacher explanations about reading 
skills increased student awareness, student achievement, and student setf- 
perceptions, 11 measures were used: 1 of the teachers' explanations, 2 of 
the students' awareness, 6 of the students' achievement, and 2 of the 
students' self -perceptions . 




Proc edures 

The study, designed as a naturalistic experiment, involved two sets 
of classrooms: a treatment group and a treated control group: The treat- 
ment teachers attended the orientation Session and six 2 -hour training 
sessions as described in the above section on "The Interventions with 
Teachers." Their reading skill lessons were observed 11 times during the 
academic year. The treated control teachers attended an orientation ses- 
sion and three training sessions as described in the same section above. 
The treated control teachers were observed 6 times during the academic 
year. 

Researchers used six observations, designated in advance, for primary 
data-collection purposes; and during these observations they collected 
data regarding teacher explanation and .student awareness of lesson content 
for both the treatment group and the treated- control group teachers. In 
these lessons teachers taught whatever reading skill was planned for that 
day as part of the routine basal text instruction. During each observa- 
tion the researcher audiotaped the lesson, recorded supplementary field 
notes, completed forms regarding the teacher's use of explanation, noted 
student engagement on tasks, recorded breaks in the activity flow, and 
noted teachers' use of the management principles associated with the 
Anderson, Evertson. and Brophy (1979) study. Immediately following the 
observed lesson, the researcher individually took five low-group students 
to a nearby room or to the hallway outside the classroom to interview them 
about the lesson. These data collection procedures were identical for 
both the treatment and the treated control groups, as described in the 
preceding section on "Measures." 
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Five additional observations, which alternated with the six desig- 
nated data-collectibh observations, were scheduled for treatment teachers. 
During these supplementary observations, researchers monitored treatment 
teachers' progress in implementing explanation techniques, provided them 
with additional coaching on how to implement the training, and audiotaped 
the lesson being taught to the low group for use in later training ses- 
sions with the teachers. No lesson interviews were conducted during these 
sUpplemiBritary observations, and the teacher data were not used to answer 
the research questions. 

Documenting Student Task^ Engagement 
While tt can be assumed that the random assignment of subjects re- 
sulted in comparable student task engagement for both the treatment and 
treated control classrooms, data were collected to document that any dif- 
ferences in student outcomes were not attributable to factors associated 
with time-on- task. Data included each teacher's management skills; the 
attendance of the low-group student subjects, and the basal text content 
coverage of each low group. The results of these data collection efforts 
are presented here to establish that: there were virtually no differences 
in student time -on- task and, ttherefore, tEask engagement variables prob- 
ably had little or no impact on the findings regarding the research ques- 
tions reported in the section that follows. 

Differences in Teacher Management 

Effective teacher management is associated with high student engage- 
ment rates. To document differences in teacher management ability, spe- 
cific observer training and data collection procedures were employed, and 
data were recorded during each observation of both treatment and treated 
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control group teachers. First, observers were trained to recognize and 
record instances in which the management principles identified by 
Anderson. Evertson. and Brophy (1979) were used: Each teacher »s rating on 
each observation ranged from a low management rating of 0 to a high of 100 
with the rating representing the percentage of the number of management 
principles used during the lesson. Second, research staff members were 
trained to identify and count instances of management problems such as 
transitions, breaks to attend to materials, shifts from lesson goals to 
something else, off -task pupil behavior, and interruptions that were 
beyond teacher control: These were termed subjective management ratings. 
Observers assigned a rating of 1 to 3 for each observed lesson with 1 
being equal to a low number of management problems and a rating of 3 
being equal to a high number of management problems. 

Multivariate analysis of covariance (MANCOVA) was condacted for 
Observations 2 through 6 for both the management principles and the ob- 
server ratings. Ratings from Observation 1, which was the baseline obser- 
vation, served as the covariate. The results indicate that there were no 
significant management differences betweeen groups (e.g.. Observation 
6--|;(10.1) - 1.319. £ - .590). The means and standard deviations for this 
set of data are displayed in Table 2. Similar results were obtained from a 
one-way repeated measures multivariate analysis of variance (MANOVA) . again 
using the management principles ratings and observer ratings as dependent 
measures across all six observations (F(i,12) « .484. g « .450). These 
findings indicate that the observers rated both the treatment and the 
treated control teachers equaiJy on management ability throughout the year. 
Consequently, differences in student outcomes cannot be attributed to 
differences in teachers' management skills. 
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Table 2 



Means and Standard Deviations For 
Management Principles and Observer Ratings 



observation 1 Oteervatidn 2 Observations Observation 4 Observations Observations 
croup „ean(SD) Hean (SD, Sean (SD, „ean (SO) Hean (SD, Sean (SD, 



Tre-5ti«nt 51.80(19.46) 68.70 (20.80) 68.00 (29.79) 81.20(19.15) r6.80 ( 23.81) 77.00 ( 21.93) 

Treated control 51.88 (19.58) 68.40 ( 24.13 ) 76.70 ( 21.38) 82.90 (18.45 ) 85.40 (19.37) 87.90 (17.89) 



Treattnent 1.75 ( 0.59) 1.00 (0.51) 1.83 ( 0.66) 1.50 ( 0.71) 1.55 ( 0.64) 

Treated Control 1.75(0.60) 1.85(0.41) 1.60(0.39) 1.55(0.43) 1.50(0.58) 



Differences in Attendance 

Regarding attendance, there were tid significant differences in the 
average attendance of iow-group students in the treatment or treated 
control groups. The mean number of days absent per low-group student in 
the treatment group was 7.86 and for the treated control group, 8,11. 
Tliis suggests that differences in student awareness and achievement cannot 
be attributed to differences in the amount of time the students spent in 
school . 

Differences in Content Coverage 

Content coverage was determined by noting how many basal text units 
were completed during the year by the low reading groups in each of the 
participating classrooms. The number of units completed by the low read- 
ing groups in treatment classrooms ranged from 3 to 6 with a mean of 5.25, 
whereas the number of units completed by the low reading groups in the 
treated control classrooms ranged from 3 to 8 with a mean of 5.50. This 
suggests that differences in student outcomes cannot be attributed to 
differences in content coverage. 

Summary of Task Engagemeat 

The above data indicate that the treatment and treated control class- 
rooms were not significantly different in teacher management skills, allo- 
cated time, or student engagement. Consequently, results cannot be attri- 
buted to task engagement factors. 

Results And Discussion 
The results for the four research questions are presented in this 
section. Correlational data are presented at the end of the section. 



33 



Question 1: Can Teachers Learn to Be^x^fil4e4^i 
Individual analyses of cbvariance were performed to examine differ- 
ences betwiseh teachers' explanations at Observations 2 through 6 (teach- 
ers' explanation ratings on Observation 1 were used as the covariate) . 
There were no significant differences in the explanation ratings of treat- 
ment and treated control teachers on the baseline observation (F(i,18) « 
3.578, £ - .061), Explanation ratings of treatment teachers were signifi- 
cantly higher than explanation ratings of treated control teachers begin- 
ning with Observation 3 (F(l,17) - 24.639, £ < .001) and continuing 
through 6 (F(i,17) - 6.118, £ - .024). Means and standard deviations are 
displayed in Table 3. 

To identify the treatment effects across the academic year, a re- 
peated measures analysis of variance using all six observations as time 
points was performed. Results indicated a L-.gnificant main effect favor- 
ing the explicitness of treatment teachers' explanations (F(l,18) - 9.267, 
£ > .001). Roy-Bargeman Step-Down F-tests revealed a significant treat- 
ment X time increase for treatment teachers between Observation 1 and 2 
(F(l,18) - 4.472, £ - .048). This suggest;3 that, even though the differ- 
ences between treatment teachers' explanation ratings and treated control 
teachers' explanation ratings was large throughout the year, the greatest 
increase in ratings for treatment teachers occurred between the first two 
observations . 

The results of these analyses also indicate that treatment group 
variances, as reflected in the standard deviations in Table 3, are some- 
what larger than the treated control group variances for Observation 1. 
However, because subjects were randomly assigned and because variances 
between groups were statistically nonsignificant, they pose little threat 
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Table 3 

Means and Standard Deviations for 
Teacher Exptanation 



Jbservation 1 Observation 2 Observation 3 Observation 4 Observation 5 (toservation 6 

Mean <S0) Mean (9)) Mean (SD) Mean (SO) Mean (SO) 

11. AS (4.45) 14.30 (7.54) 15;10 (6.18) 15.80 (7.56) 13.85 (6.63) 13.40 (6.90) 

13.40 (5.60) 17.60 (8.01) 1^.90 (9.00) 21.30 (6.46) 18.50 (5.66) 17.70 (6.89) 

9.50 (1.43) 11.00 (5.62) 10.30 (2.41) 10.30 (3.43) 9.20 (3.55) 9.10 (3.44) 
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to internal validity. Increases in variance for the treatment group iii 
Observations 2 through 6 can be attributed to the facility with which 
some teachers implemented explanation training. In addition, the slight 
decline in explanation ratings in both groups at the end of the year is 
not seen as a serious problem: Whereas the effects of training may have 
diminished across the school year, it is more likely, given the con- 
straints on teachers' time at the end of the school year, that teachers 
had less time available to plan and to conduct lessons later in the year 
than earlier in the year. 

In sum, the results substantiate that teachers can become more ex- 
plicit in explaining reading skills as strategies. This result is con- 
sistent with the results of previous studies (Duffy, Roehler, Meloth, & 
Vavrus, 1986). 

Question 2: Is E xplanation Related to Student Awareness 
The second question asked whether explicit teacher explanation helps 
low group students to be more aware both o£ lesson content and of the 
strategic nature of reading generally. Two measures were employed, one 
for awareness of lesson content and one for awareness of the need to be 
strategic when reading. All student awareness data were aggregated by 
classroom. 

Awareness ofl Lesson C oated 

To investigate the differences in awareness of lesson content between 
students in treatment and treated control classrooms, multivariate anal- 
ysis of variance, multivariate analysis of covariance, and repeated mea- 
sures analysis of variance procedures were used. For the MANGOVA, ratings 
of responses for the three awareness categories (what was the lesson about 
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or declarative knowledge, why is it useful or situational knowledge, how 
do you apply what you were taught or procedural knowledge) were the de- 
pendent measures. Ratings for each of the above three categories for 
Observation 1 (the baseline observation) was the covariate for the MANGOVA. 
Table 4 gives ::he means and standard deviations for awareness at each 
observation; 

Multivariate analyses of variance indicated no differences in aware- 
ness of lesson content between students in treatment classrooms and stu- 
dents in treated control classrooms for the baseline (Observation 1) 
(F(3,16) - 0.538, 2 -663). Even though there were no initial differ- 
ences between groups on baseline awareness ratings, MANCOVAs were per- 
formed to increase the power of the F-test. As shown in Table 5 this 
multivariate analysis revealed that students in treatment classrooms were 
rated higher in their overall awareness of lesson content for the sixth 
(or final) observation (F(3,13) - 5.66, 2 - -Qi). Univariate analyses 
indicated that this difference at the final observation was due to signif- 
icantly higher ratings on two of the three categories: situational knowl- 
edge (F(l,15) - 18.29, 2 < .001) and procedural knowledge (F(l,15) - 8.71, 
2 < .001). No differences were found between groups for declarative knowl- 
edge (F(l,15) - 2.99, 2 - .104). 

Additional MANCOVAs revealed that the above differences between stu- 
dents* awareness of lesson content in treatment and treated control class- 
rooms first appeared at the fourth observation (F(3,13) « 3.449, £ - .0485). 
At the fourth observation, the situational knowledge and procedural knowl- 
edge categories were found to contribute to the main effect (F(l,15) - 9.316, 
2 - .0080 and F(l, 15) - 9. 728 , 2 " -007, respectively). No differences 
were found at any time between groups on declarative knowledge. 
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Table 4 



Means and Standard Deviations for 
tesson Interview Ratings for Observations 1 through 6 



^ Observation 1 Observation 2 Observatioji 3 Observation 4 Oteervation 5 Observation 6 

Awareness Mean (SD) Mean (SD) Mean (Su) Mean (SD) Mean (SO) Mean (SO) 



verall total 

Declarative 
Sitf:';tionat 
Procedural 



"eatment total 

Declarative 
Situational 
Procedural 



eated control total 



Declarative 
Situational 
Procedural 



3i32 (1.15) 

1.27 (.411) 
0.760 (:676) 
1.26 (.670) 



3.58 (1.83) 

1.28 (.465) 
0.915 (.840) 
1.36 (.819) 



3.02 (1.12) 

1.26 (.3W 
0.60 (.457) 
1.16 (.503) 



3.29 (1.59) 

0.97 (.631) 
1.06 (.602) 
1.26 (.696) 



3.62 (1.37) 

1.08 (.641) 
1.12 (.635) 
1.41 (.511) 



2.96 (1,80) 

D.85 (.633) 
0.998 (.593) 
1.11 (.843) 



4.57 (1.67) 

1.60 (.522) 
1.23 (.958) 
1.74 (.758) 



4.86 (2.19) 

1.53 (.570) 
1.51 (1.230) 
1.81 (.832) 



4.28 (0.95) 

1.67 (.490) 
0,95 (.502) 
1.66 (.712) 



4.47 (1.59) 

1.50 (.619) 
1.17 (.778) 
1.78 (.778) 



5.51 (1.59) 

1.58 (.410) 
1.67 (.657) 
2.26 (.679) 



3.44 (1.33) 

1.42 (.795) 
0.69 (.562) 
1.30 (.557) 



4.80 (1.67) 

1.55 (.526) 
1.20 (.917) 
2.03 (.752) 



5.53 (1.63) 

1.66 (.537) 
1.59 (1.02) 
2,31 (.850) 



4.04 (1.40) 



1,45 (.522) 
0.81 (.627) 
1,76 (.681) 



4.45 (1.98) 

1.25 (;588) 
1;32 (.855) 
1;58 (.867) 



5.84 (1.23) 

1.75 (.447) 
1.95 (.561) 
2.11 (.677) 



3.06 (1.41) 

1.29 (.644) 
0.68 (.583) 
1.06 (.719) 
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MANCOVA® For lesson Interviews: Observation 6 
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Finally, one-way repeated analyses of variance, using the six obser- 
vations as time points (i.e., when interviews were conducted) were per- 
formed to examine the differences in students* awareness of lesson content 
across time. Results indicate that ratings for overall awareness (sum of 
the three levels) increased gradually throughout the year for students in 
treatment classrooms (^(1,18) - 13.650, £ « .002). The same analyses 
performed on each of the three types of knowledge revealed that treatment 
students were significantly more aware across time than treated control 
students for situational knowledge (|(1,18) - 11.070, £ « .004) and for 
procedural knowledge (F(l,18) - 9.890, £ - .005), but not for declarative 
knowledge (F(l,18) - 2.127, g - .161). These lesson interview results 
indicate that low- group students who are taught by teachers who provide ex- 
plicit explanations of the mental processes involved in using skills stra- 
tegically became more aware across time of the situational and procedural 
knowledge presented during the lesson. Treatment and treated control stu- 
dents' awareness of declarative knowledge was equal across time. 

In an exploratory analysis, the researchers also analyzed the data by 
levels to examine the h3rpothesis that explicit explanations would result 
in increased student awareness at tevei 1- -general awareness. Group 
differences were found in Observations 4 through 6 for the Level 2 ques- 
tions (£ « .008, .031, and .001 respectively) but not for Level 1 or Level 
3. Thus, the hj^othesis was not supported. interview questions directed 
toward specific lesson content (Level 2) were more likely to discriminate 
between treatment and treated control students. 

In sum, the lesson interview results Indicate that students who re- 
ceive explicit explanations about the use of reading skills as strategies 
report more awareness of lesson content following instruction than students 
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who receive less explicit explications. Stated in terms of student media- 
tion of instruction (Doyle, 19831 Winne . 1985), students who receive explic- 
it explanations more accurately mediate instructional information presented 
during lessons. 

Awarenesig ^ the^Jtrategic Nature of Reading ; 

To determine how aWare students were of the strategic nature of 
reading generally, researchers analyzed the 60 concept interviews col- 
lected from the 20 classrooms at the end of the study using verbal report 
analysis procedures suggested by Ericsson and Simon (1984). 

Two procedures were used. First, researchers examined and catego- 
rized students' responses to each of the four questions individually. This 
gave the researchers an understanding of the range of responses to each oi 
the questions. Second, researchers discussed the interview responses 
across all four questions in an attempt to Identify the overall concept of 
reading possessed by each subject. Whereas the intention of the interview 
ratings was not to impose any predetermined categorization schvsme, as a 
general guideline statements were examined for evidence of strategic 
reading (Paris, Lipson, & Wixson, 1983). Thus, questions asked of stu- 
dents during the interviews were intended to assess overall knowledge of 
the reading process independent of specific lesson content. 

Assessing concepts for evidence of strategic reading seemed important 
for two reasons. First, the project trained teachers to explain reading 
skills as a strategic process, which required flexibility on the part of 
the reader. Thus, it was expected that "good" responses to these ques- 
tions Would indicate a concept of reading as an active process of compre- 
hending text. Second, conceptualizing reading as a strategic prov,ess 
represents cognitive psychology's current view of reading and comprehension 
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(Baker & Brown, 1984) and, therefore, "good" responses should include 
elements of this view. 

With this as a general guideline, the researchers began the analysis 
by examining each of 16 randomly selected interviews for evidence of stra- 
tegic reading. Through discussion, 10 categories emerged and are listed in 
Table 6. A seven-point Likert-type scale was used to ensure adequate 
differentiation in the range of responses for each of the 10 concept cate- 
gories. Once this categories and scoring system were agreed upon, each 
researcher then examined each of the 16 transcripts individually to see if 
he or she could identify examples of the 10 categories. This was done to 
eliminate any influence of group discussion in identifying elements of 
reading concepts. The remaining 44 interviews were then analyzed. 

MANOVA procedures were used with the 10 concept categories serving 
the dependent measures. The means and standard deviations are given in 
Table 6. The MANOVA revealed a significant difference in the overall 
concept interview rating favoring students in treatment classrooms 
(F(10,9) - 7.55, £ - .0027). As noted in Table 7, 6 of the 10 categories 
contributed to the difference between the two groups: 

Reading is a self - directed activity: F(l,18) - 19.330, £ < .001, 
Reading involves problem solving: F(l,18) - 5 . 145 ^ £ < .05, 
Skills and rules aid in comprehension: £(1,18) - 5.626, £ < .05, 
The purpose is to get meaning: F(l,18) - 5.^84, £ < .05, 
Reading involves conscious proces.siug: F(l,18) - 5.567^ £ < .05, 
Reading involves selection of strategies: F(l,18) - 4.12, £ < .05. 
While low-group students* metacogtiitive awareness of reading in gen- 
eral is often characterized as poor (Canney & Winbgrad, 1979; Myers & 
Paris, 1978), these findings suggest that these more global concepts 



can 



42 



51 



Table 6 



Means and Standard Deviations for 
Concept Interviews 



Concepts 



Treatmeht 



Treated Control 



Total 

Involves intentional ity 

Involves effort 

Is systematic 

Is self -directed 

Involves problem solving 

Uses skills & rules 
to get meaning 

Is enjoyable 

IS iiieaning- get ting 
activity 

involves conscious 
processing 

involves selection of 
strategies 



Mean 



3.11 

2.53 
3.33 
2.96 
4.43 
3.00 

2.57 
4.13 



3.37 



(1.01) 
(1.04) 
(1.65) 
(1.70) 
(0.89) 
(1.16) 

(1.06) 
(0.23) 



2.77 (1.17) 



(1.44) 



Mean 



2.21 
1.78 
3.12 
1.78 
2.68 
1.93 



(SD) 



(0.56) 
(0.85) 
(1.37) 
(1.13) 
(0.89) 
(0.92) 



2.00 (1.02) 



1.68 (0.5C) 

3.97 (0.39) 

1.73 (0.76) 

2.13 C0.80) 

1.28 (0.46) 



Table 7 



HANOVA for Concept Interviews 



Sum of Squares Cross Products 
Con Cori Con Con Con Con Con Con Con Con 
123456789 10 



^1 "l 



16.2 
16.4 
15.1 
4.9 
12.3 
6.0 
1.0 
14.5 
17.7 
7.0 



41.4 

35.3 37.1 

19.4 16.8 



25. D 
13.4 
1-6 

ir.1 

21.2 
12.9 



24.1 
14.5 
2.2 
17.7 
22.5 
13.9 



14.3 
11.0 
6.3 
-.02 
7.7 
6.2 
5.7 



19.9 
10.2 
0.5 
12.5 
16.4 
10.3 



12.5 
0.4 
8.0 
8.6 
9.2 



1.9 
1.0 
1.6 
-.02 



17.5 

17.7 24.6 
7.1 10.3 



11.2 



2.8 
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change when explanat±5Ss about specific strategies are explicit; Whereas 
the differendes were smill, treatment students' growing knowledge cf h8w 
to use skills as strategies may have helped them develop a different 
global view of readiHg than their treated control counterparts, leading 
them to begin thinking about reading as a sense-making activity that can 
be controlled by applying strategies. Although the absence of a baseline 
measure in this category demands some caution, it nevertheless seems that 
students who receive explicit explanations about using skills as strate- 
gies may come to understand that reading itself is a strategic act. 

In sum, the results of the two awareness measures indicate that, when 
teachers are explicit in explaining reading skills as strategies, students 
report more awareness of lesson content and of the strategic nature of 
reading generally. This Suggests that they are metacognitively aWare and 
are mediating instructional information in qualitatively different ways 
than their counterparts in the treated control group. 

Question 3: Is ExTslanation Relat ed to Student Achievement? 
The third question asked whether explicit teacher explanations are 
associated with more conscious student use of skills as strategies aud 
with improved student achievement. Six measures were employed, two were 
traditional achievement measures and four were nontraditional achievement 
measures. Ail the achievement measures were aggregated by ciassrooi... 

Traditional Achievement Measures 

Two traditional measures of student achievement are the reading part 
of the Stanford Achievement Test and the Michigan Educational Assessment 
Program. The SAT reading section consisted of two subtests, comprehension 
and word stu^. The pretest for the SAT was taken in Spring 1984 when the 



45 

55 



students were at the end of the second grade. No significant difference 
on the SAT was found between groups at that time (F(2,17) - 1.288, p - 
.301). Even though no initial differences were found, to increase the 
power of the F-test for the 1985 SAT results, a multivariate analysis of 
covariance was performed, with the 1984 SAT results used as a covariate. 
Means and standard deviations can be found on Table 8. 

As shown in Table 9 MANGOVA analyses indicated a significant overall 
difference favoring the treatment classrooms (F(2,15) - 4.16, £ < .05). 
Univariate tests of significance found significant differences favoring 
the treatment group on the word study subtest (F(l,16) - 8.09, p < .01). 
No differences were found on the comprehension subtest (F(l,16) - 0.37, 
g - .549). The growth in the word study subtest (as opposed to the compre 
hensibn subtest) is sensible when one considers that the skills taught by 
the third-grade teachers in this study often emphasized identifying and 
understanding the meaning of individual words. 

The second traditional measure of achievement used was the MEAP. It 
was given in the beginning of the fourth grade in the academic year 
following the study and gave each student's total reading score on the 
reading portion of the test. Consequently, a one-way analysis of variance 
procedure was used. The means and standard deviations are given in Table 
10. Results revealed that students from the treatment group scored sig- 
nificantly higher than their treated control group counterparts (F(l,l8) = 
5.723, £ -» .029). This may indicate that students in treatment classrooms 
were more successful than students in treated control classrooms at main- 
taining the differences established in the year of the study. 

In sum, the results of these two measures indicate that students who 
received explicit explanations of how to use skills as strategies achieved 
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Table 8 



Means and Standard Deviations for 
Stanford Achievement Test, Scaled Scores 



Pretest 
198A 



Posttest 
1985 



Measure 



Group 



Mean 



SD 



Group 



Mean 



SD 



Word study 



Treatment 568.85 16.81 

treated control 556.75 18.35 



treatment 595.19 
Treated control 568.74 



17.74 
14.73 



Comprehension 

Treatment 553.64 21.30 Treatment 590.7« 19.71 

Treated control 538.85 24.65 Treats control 585.86 19.77 



57 



Tabte 9 



MANCOVA For Standford Achievement Test Conprehension 
and Word Study Subtests 
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Table 10 



Means and Standard Deviations for 
Michigan Educational Assessment Program 



Group Mean SD 



Treatment 2O.8I 4. 618 



Treated control 17.26 0.739 
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better on traditional achievement tests than students who received less 
explicit explanations. This finding is particularly important because 
previous studies of strategy instruction did not produce significant 
differences in standardized test resultts (Duffy, Roehler, et al . , 1986; 
Paris, Cross, & Lipsbn, 1984). 

Nontraditional 



The Supplemental A chievemen t Measure . The first nontraditional mea- 
sure used was the Supplemental Achievement Measure. The SAMs were admin- 
istered to target students on a schedule dictated by the respective teach- 
ers' coverage of basal text content. Consequently, the number 6f skills 
tested at any one aaSinistration varied from classroom to classroom, al- 
though there were no significant differences between classrooms in the 
total number of skills tested during the year. However, no two classrooms 
covered the same number of skills. Consequently, the analysis was based 
on the percentage of correct items aggregated by classroom across all the 
tests administered during the academic year. 

The mean percentage of correct responses was calculated for the stu- 
dents of both the treatment teachers and the treated control teachers on 
both Part I and Part II of the measure, and a multivariate analysis of 
variance was performed to determine if there were significant differences 
in the mean scores of the two groups. Table 11 gives the means and stan- 
dard deviations. As seen in Table 12, the MANOVA revealed that there was 
a significant main effect favoring the treatment group (F(2,17) « 6.688, 
688, £ - .0072). The Part 11 portion of the SAM contributed to this sig- 
nificance (F(l,18) - 13.331, 2 - .0018). There was no difference 
between groups for the Part 1 items (F(l,18) « .18, g - .6739). 
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Table 11 



Means and standard Deviations for 
Supplemental Achievement Measures 



Part 



Group 



Mean 



SD 



Part I 



Treatment 
Treated control 



59.60 
62.50 



20.10 
7.40 



Part II 



Treatment 
Treated control 



56.28 
39.62 



12.30 
7.60 



Denotes separate variance estimate. 
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Table 12 

MANOVfA For SuppleniePtal Achievement Measures 
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The SAM results tend to support the basic hypothesis that students 
who receive explicit explanations about how to apply skills as strategies 
not only can do the task but also demonstrate they are conscious of how 
they performed the task. The fact that both the treatment and the treated 
control groups did equally well in performing the skill tasks themselves 
(the first partE of the measure) but differed significantly in their abil- 
ity to select appropriate statements regarding why they chose the answer 
they did (the second part) is particularly helpful in establishing that 
explicit explanations help low-group students become more consciously 
aware of how to use skills as strategies. 

The Error Detection Test . The second nontraditional measure was the 
Error Detection Test. These data were analyzed by applying a formula de- 
veloped by Paris, Cross, and Lipson (1984). Each student received a score 
for semantic error detection and for syntactic error detection. The scoi'i:s 
were derived by subtracting incorrect answers from correct answers and di- 
viding the results by the total number of correct answers. All data were 
aggregated by classroom. An analysis of covariance was used to determine 
differences between the two groups. The results indicate that scores were 
uniformly low across all students and that there were no significant c'if 
ferences between treatment and treated control groups for semantic errors 
(^(1,17) - 0.115, £ = .738) or syntactic errors (F(l,17) - 0.269, 
g = .611). It is hypbthejsized that the Error Detection Test was inap- 
propriate for a student population consisting only of low-group third 
graders . 

The Modified Graded Oral Reading Paragraph . The third nontraditional 
measure, the Graded Oral Reading Paragraph test was analyzed by examining 
target students' pre- and posttest verbal reports about how they 



self-corredted and how they figured 6ui the embedded words "grub" and "un^ 
covered:" Three researchers analyzed the verbal self -reports . For each 
administration of the GORP, researchers noted the ncmiber of verbal reports 
given for both self -corrections and the embedded words, whether the focus 
was on word recognition or word meaning, and the percentage correct for 
word-recognition and/or word-meaning strategies. Conventions for analy- 
zing the verbal reports were developed by the researchers and guided their 
analysis. Reliability among the raters was .82. 

Both a multivariate analysis of variance and a multivariate analysis 
of covariance using the word-recognitiOn and word^meaning pretest scores 
as the covariate were used to determine differences between treatment 
students and treated control students. All student data were aggregated 
by classrooms. Table 13 shows the means and standard deviations. There 
were no significant differences on the pretest (F(2,16) .0967, 2 - 
.9083). Although there were no pretest differences, a multivariate analy- 
sis of covariance was used for posttest scores, with pretest scores used 
as the covariate. As seen on Table 14 the MANCOVA indicat?!d that t^-re 
was a significant overall main effect on the posttest favoi the ^at- 
ment group (F(2,14) - 51.32, 2 < .001). Univariate r test^ indicated f.hat 
treatment students did better than treated control st > . ents c-^. ooth the 
word-meaning subtest (F(l,15) - 10.86, 2 < -005) and on the word- 
recognition subtest (F(l,15) - 105.783, 2 < -001). 

The results of the modified Graded Oral Readings ■ ava,.. a; : .t sug- 
gest that low-group students who deceive explicit explaiac. > ■ ' tc 
use skills as strategies tend to use such strategies whci. r.-ri.sivii J 
Additionally, these results are significant because they provide furtr sr 
support for metacognitive awareness, that is, the students of treaLmv Vi . 
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Table 13 



Means and Standard Deviations For 
Graded oral Reading Paragraph 



Pretest Pos^t^es^ 
Group Mean SD Group Mean 



'o';^ Treatment .56 .21 Treatrnent .96 .06 

recognition Treated controt .53 .39 Treated control .51 .12 



Word meaning Treatment .25 .25 Treatment .65 .25 

Treated control .26 :29 Treated control .25 .28 
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Table 14 



MANCOVA For Graded Orat Reading Paragraph: 
Word Meaning and Word Recognition 



Source j 




Sum of Squares 


Cross product 






Univariate F 




Word Meaning 




Word Recognition 


•| Multivariate | 

1 £ <df) 1 
1 1 


Word Meaning Word 


r^*^stanic j 


1 j 




°1 


^1 




1 1 
1 1 




- . gro'ips j 
.wo, its 1 
fjr.at^j^) j 


1 j 


.741 
.831 




.931 




1 1 
1 51,32** (2,14) 1 


10.86* 


(«li"\ ngting 1 
riisigr. effects)] 

1 

i 


2 I 

t 

1 

\ 


.169 
- .0i>4 




.029 




1 1 




within groups j 
(eliminating j 
covariates) j 


15 1 


1:024 
.181 




:132 


1 1 

1 I 


Total 1 

1 


19 1 















* p < .oor 

* p < .001 
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tisachers not only used the skills but, in the process of reporcing hou^ 
they used them, demonstrated conscious awarenes*^ reflecting the instruc- 
tion provided by treatment teachers. 

Magazin e^ Test results . Researchers also noted Magazine Test scores. 
ThiBse criterion-based tests accompany the Houghton Mifflin basal series 
used by all the teachers in the study. Skills presented in the basal text 
book ^ere tested by five items on the Magazine Tests. Students had to get 
correct answers for at least four of the questions; if they did not meet 
this criterion, they were retested. For this study, only the scores teach 
ers reported from the first administration of the test were used. The 
scores analyzed were for those skills that could be recast as reading 
strategies (70% of the skills tested). The target students' raw scores 
were converted to percentage correct and were aggregated by classroom. 
The mean percentage correct for the treatment classes was 88.25%; for the 
treated control classes it was 82.53%. 

A separate variance estimate Jt-test was used because theri were 
significant differences in variances between the two .roups on this mea- 
sure. The t-test indicated that the difference between these scores was 
significant ( t - 2 . 17 , df - 13 . 6 , g - .048). The means and standard 
deviations are displayed in Table 15. These results are additional sup- 
port for the hypothesis that low- group students receiving explicit expla- 
nations about reading strategies perform better on nontraditional measures 
than those who do not. 

Sunmiary Discussion of Achievement Results 

The results of the achievement measures indicate that students of 
treatment teachers achieved better than students of treated control teach- 
ers on both traditional measures of reading achievement and on three of 
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Table 15 



Means and Standard Deviations 
For Magazine Tests 



Group Mean SD 

Treatment 88.25 29-69 

Treated control 82.53 6.6^5 
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the four nbht^iditionai measures. These results lend siring support to 
the hypothesis that explicit teacher explanation of the mental processing 
involved in using skills as strategies results ^n more conscibus student 
use of skills as strategies and in improved achievement on a variety of 



measures 



Ques tion 4: Is Explanation Related to Student Self -Perception? 
An exploratory question asked whether explicit teacher explanations 
are associated with improved student self -perception of themselves as read- 
ers. TWO measures of self -perception were employed: One was an indican. 
of students' perceived place in the reading group and the second was a 
measure of the. students' perceived quantity of reading at school and in 
the home. It was hypothesized that treatment students who were taught to 
use skills as strategies would perceive themseivas as better readers and 
that they wc :ld read more at home and at school as they improved their 
awareness and achievement. 

Researchers used tests to analyze the responses of the three target 
students from each treatment and treated control classroom on both mea^ 
sures. The results indicate no significant differences between the groups 
in either the perceived place in the group or in the quantity of reading 
done at home or in school. Therefore, further analysis was not attempted. 

The lack of significant differences may be explained by various 
factors. Fj.rst, the two measures themselves may not have been sensitive 
indicators of self -perception. Second, the students may have responded 
not in terms of theiir actual self -perceptions but in terms of how t;he;y 
thought the interviewer expected them to respond. Finally, because the 
students were asked to compare themselves to others within their reading 




group, une would not expect differences between groups. Perhaps measures 
which directly tap students* thoughts about their improvement in reading 
would be more appropriate. 

Correlational Data 
In addition to the primary data collected about each of the four 
research questions, correlations were computed among the data using 
Pearson Product Moment correlations. A variety of significant corxii- 
lations were found (see Tables 16 through 20). No attempt tr iv.i N3 
discuss all these corrislations here. The correlations seiecteci :cr d^s- 
cussion are those reflecting most directly the hypotheses of th.: ^tudy. 
Thus, the correlations between teacher explanation and stui^nc av-c^rencss 
are reported as a means for further illustrating the relationship between 
what the treatment teachers were taught to do and the hypotheses about 
increased students awareness. Additionally, correlations between student 
awareness anr achievement as well as correlations among the various 
achievement measures are presented to illustrate the relationships among 
these outcome measures : 

Correlations Between Teacher Explana^t4on 
and Stud e nt Awareness 

The correlations of teacher (Bxplanation scores with student awareness 
as measured by lesson interview scores yielded significant findings for 
the fourth, fifth, and sixth observations (see Table 16). As noted 
earlier, teacher explanation scores improved dramatically for the second 
observation and continued a modest but positive growth throughout the 
year. The fact ihi.t significant differences in student awareness of 
lesson content did not appear until the fourth observation suggests that 
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Table 16 

Pearson Product Moment CoriolbtiorJ Between 
Teacher Explanation and Lesson Interviews 



Lesson Interview 

Observation 1 db:.arvation 2 Observation 3 Observation 4 Observation 5 Observatior 

.156 .2A6 -126 .763** .488* .433* 



< .05 

< .01 
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student internalization of explanations about using skiiis strategically 
occurs over time. 

Correlations Amon^ S tudent-Qat^ome-^asures 

There were several significant correlations between (a) the two 
awareness measures, (b) between the rv- awareness measures and the various 
achievement measures, and (c) anong various achievement measures. 

There was a strong, positive c:; c: . .tion between the lesson interviews and 
the total score for the concept intei.-view at Observations 4 through 6. 
Because the concept interview score represented ; sum of 10 categories, 
each of these separate cr egories were a^so cor . l.::t:. - ."ith the lesson 
interviews. As can be seen in Table 17, f. of tho IC - ncept incerview 
categories; were positively associated with lesson interviews at the end of 
the year. In addition, close inspection of the table reveals that, with 
the exception of the category for "Reading is Enjoyable," the strength of 
the correlations between the concept intervi-.ws and lesson interviews 
increased across the six observations, lending furtner support to the 
finding that students gradually improve their awareness of lesson content 
as instruct: on progresses. 

Regarding the relationship between lesson interviews measures and 
achievement measures, at the last observation the lesson interview scores 
were significantly correlated with four achievement measures: the SAT 
word study, Part 11 of the SAMs , the MEaP, and the GORP word meaning (see 
Table 18). These correlations suggest that at the end of the year ratings 
of student awareness of lesson content corresponds with their performance 
on both nontraditibhal (SAM) and traditional achievement measures (SAT) . 

The concept interviews were also significantly correlated with sev- 
eral of the nontraditional and traditional achievement measures (see 
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Table 17 

Pearson Product Honieht Corrislations Between 
tesson Interview and Concepts Interview 



observation 2 



.1326 



tesson Interview 
Observation 3 Observation 4 Observation 5 



:1963 



.4445* 



.3812* 



Observation 6 



.6720** 



.0498 



.1019 



.1283 



.1718 



.2952 



.0927 
.2555 
.46^1* 



.1694 
.0564 
.2769 



.1391 
.2683 
.4467,* 



.0726 
.2035 
.5379** 



.3311 

.5646* 

.7567* 



5139 



.2552 



.3869* 



.3604 



:5799* 



.4196* 
-.0328 



.5745* 
.1897 



.3755* 

:0337 



.6587** 
.0404 



:0036 



.1402 



.2798 



.3565 



.4776* 



»0009 



-.0021 



.3431 



.2341 



.4329* 



.2403 



.2232 



.4551* 



.2647 



.5760* 
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Tsbte 18 

Pearson Product Moment Correlations Between 
Lesson Interviews and Stanford Achievenient Test, Suppleroehtal Achievement Measure, Magazine Tests^ 
Michigan Educational Asssessrnent Program, and Graded Oral Reading Paragraph 



Test 



Observation 1 



Observation 2 



Lesson Interviews 
Observation 3 Observation 4 



Observation 5 



Observation 6 



85 SAT total 

35 SAT-Uord Study 

55 SAT- 
:omprehension 

( Total 

(-Part I 

l-Part II 

lazine total 

iP 

P-Word 
recognition 

P-Word meaning 



.1444 
-.0001 
-.0548 

-.2543 
-.3929* 

.1981 
-.2942 

:3482 

.2315 
.0024 



.0336 
.3103 
-.1409 

.2538 
-.4177* 
.2905 
.1396 
-.0103 



:2364 
.3467 



.1034 
.2253 
.2881 

.1343 
.1929 
.2382 
.2666 
.3865* 

.4242* 
.2432 



.3303 

.4046* 

.0214 

.3387 

.0805 

.3886* 

.0628 

.4813* 

.4221* 
.3346 



.5587** 

.4431* 

.4909* 

.5597** 
-.-^^93 
.5154** 
.4323* 
.5658** 

.1869 
.2600 



.7623** 
.2998 



-.2399 
.7110** 
.3766 
.6443** 

.2576 
.4428* 



* B < .05 

* B < .01 
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Table 19). The overall concept rating was significantly correisted with 
the 1985 SAT Word Study subtest, Part II of the SAMs , the MEAF score, 
and the word-recognition and word-meaning categories of the CORP. The 
individual concept categories that were most often associated with achieve- 
ment measures were those categories labeled "self -directed, " "uses skills 
and rules to get meaning," and "selection of strategies." This suggests 
that certain aspects of a global conceptualization of reading are associ- 
ated with achievement in reading. The several- positive correlations among 
the nontraditional and traditional achievement measures (see Table 20) 
suggests a strong relationship among these Masures . 

Summ ary of G arrelational Finding^s 

The significant correlations between teacher explanation and student 
awareness, and among student scores on lesson interviews, on concept 
interviews, on nontraditional achievement measures, and on traditional 
achievement measures supports the findings of the basic research ques- 
tions. Improved teacher explanation is associated with student metacog- 
nitive awareness; this awareness, in turn, is associated with improved 
reading performance on a variety of traditional and nontraditional 
achievement measures. 

Implications 
Major Implications 
This study documents the importance, during low-group reading 
instruction, of explicit teacher explanations of the mental processing 
associated with cognitive tasks. Two major implications emerge. 

Firist, explanation of mental processes is established as a component 
of instruction. This is important because explanation of mental processes 
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Table 19 

Pearson Product Moment Correlations Between Concepts Interviews and 
Stanford Achievement Test, Supplemental Achclvefnent Measure, Magazine Test; 
Michigan Educational Assessment Program, and Graded Oral Reading Parngraph 



Involves Involves is Sys- Is Self- Invovlis Skills/rules is Purpose Is Involves Selection Total 

Test Intentionality Effort tematic Directed Problem to Get Meaning Enjoyable Meaning Conscious of (overall 

So'-^^^S Gettina P"ocessing Strategies score) 



1985 SAT 
Total 



.1133 



1985 SAT Word 
Study .0797 

1985 SAT 

Comprehension .2343 
SAM Total .1354 
JAM-Part I -.0384 
JAH-Part II .2750 



lagazine 
Total 

lEAP 



.4098* 
.1503 



lORP-Word 

Recognition .1376 
ORP-Word 

Meaning .2624 



.0061 .1989 .4679* .2450 



.0702 .2788 .5045* .3362 



.1582 
.0683 
.0680 
.2156 



.2495 
.4475* 
.2182 
.5571*' 



.3771 
.6819** 
-.1610 
.7636** 



.2697 
.3227 
-.1274 
.4803* 



.1579 .0991 .4459* .1517 

.1704 .3535 .5425** .3902* 

.0037 .1776 .5779** .3319 

.1787 .2413 .5449** .4678** 



.3258 

.3904* 

.3864* 
.5804** 
-.0737 
.6447** 

.1272 
.7245** 

.4105* 

.2310 



-.1366 .2023 .1903 .4420* 



-.1120 

.0742 
.1997 
.0042 
.2756 



.1818 

.2900 
.4597* 
.0551 
.5525** 



.1362 

.1869 
.3471 
.1341 
.4568* 



.4720* 

.3994* 
.3961* 
.2156 
.4384^ 



.4109* 
.2802 

-.0988 
.5693** 



.0469 .3710 .2263 .1862 -.0152 

.0747 . 3492 . 2427 . 4573^' .4140* 

.1999 ;2903 .3019 .3441 .4123* 



.0098 .1292 



.2666 .4038* .4160* 



* B < .05 
** B < .01 
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Table 20 

Pearson Prodact Moment Correlations Between 

J^^^' Supplemental Achievement Measure, 
Magazine Tests and Michigan Educational Assessment Program 



Test 



1985 SAT- 
Word Study 



1985 SAT- 
Comprehisnsfon 



SAM- Content 



SAM-Process Magazine Total mEAP 



1985 SAT -Word Study 

1985 SAT -Comprehension 

SAM-Content 

SAM-Process 

Magazine Total 

M£AP 



1.0000 



.3754 
1.0000 



-.1306 
-.0212 
1.0000 



.4163* 
.3201 
-.3303 
1.0000 



.4266* 
.3290 

-:2105 
.3847 

1.0000 



.3505 
.3438 

-.0650 
.7417 
.3110 

1.0000 



* fi < .05 
'* fi < .01 
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is not emphasized in instructional research generally (see Brophy & Good: 
1986; Rosenshine, 1986) or in reading instructional research particuiariy 
(see Au, 1979; Paiincsar & Brown, 1984; Paris, Cross & Lipson, 1984; 
Pearson, 1985). in fact, reading researchers such as Tierney and 
Cunningham (1984) suggest that explaining mental p -ocesses may be "fraught 
with danger." This study suggests that such fears are groundless, that 
mental acts can be explained and that such explanations result in better 
student outcomes than when a teacher employs the more conunon practice of 
demonstrating a cognitive task as students watch, then coaxing them to do 
the same thing, and then assessing to determine whether or not they did 
it. 

The second Implication focuses on the student's role in instruc- 
tion. By focusine on student awareness as well as achievement, the study 
highlights the student's role as a mediator of instructional information 
and suggests that this mediational process takes time, at least with low- 
group third graders. Rather than immediately absorbing instructional 
information, students restructure the information on the basis of past 
experiences and their goals in the instructional setting: Gradually, as 
teachers present explanations across the academic year, students modify 
their understandings in the ways intended by the teacher (Duffy & Roehler, 
i986b) . This gradual development is supported by the increasing aware- 
ness scores of treatment students over the academic year: These increas- 
ing awareness scores, in turn, are associated with expiicitness of the 
teacher's explanations. The more consistent the teacher is in proviaing 
explicit explanations throughout the academic year ore likely it is 

that students will mediate instructional informa ;.rj iy and, ulti- 

mately achieve the intended goal. 
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In sum, the combinativui of the student's mediational role and the 
effects bf explicit teacher explanations suggests a model for instruction 
(Duffy, Rbehler, Meldth, & Vavrus , 1985). This model states that the 
most efficient way to instruct is to provide instructional information as 
explicitly as possible to increase the possibility that the students will 
understand what is intended by the teacher, with a causal relationship 
possibly existing between the teacher's explanation and the degree of stu- 
dent awareness and between student awareness and student achievement. in 
short, the better the explanation, the greater the awareness; the gr^.acer 
the awareness, the better the achievement. 

Addi tional Impli ca^ians 
In addition to the major implication noted above, the study suggests 
three other implications: implications regarding the nature of explana- 
tion, implications regarding the complexity of cognitive learning, and 
methodological implications . 

The Nature of Explanation 

Explanation is usually conceptualized as modeling; the explanation is 
often thought to be over whcm the modeling ends. This study suggest that 
this view of explanation is too narrow. The best expl. s continue 
explanations throughout the lesson, elaborating on the lesson content in 
response to the restructured understandings students develop as they 
mediate what the teacher says (Duffy & Roehler, 1986b, 1987; Duffy, 
Roehler, Meloth, & Vavrus , 1986). Those teachers v:ho continue explana- 
tions beyond modeling by responsively elaborating on students* restruc- 
tured understandings are more effective than teachers who simply provide 
explicit models. Consequently, an important implication of this study 
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is that it broadens the traditional definition of explanation, suggest- 
ing that simply "front- loading" lessons with an explicit model is not 
enough . 

Cbfitiitive Learning 

Regarding cognitive learning, this study documents its complexity in 
two wayr: . First, low-group third-grade students do not immediately re- 
spond to instruction on cognitive ta^ik For instance, in the study 
reported here it took until Observat: on 4 to achieve significant differ- 
ences in treatmeni; students' awareness of lesson content regarding the 
mental processes rssociated with using skills as strc. les, despite very 
explicit instruction in Observations Two and Three. Instead of immediate 
awareness, awareness increased gradually over the course of the academic 
year. This suggests that, when instruction for cognitive outcomes such as 
those associated with this study is consistent and continuous, low-group 
third-grade students grr-duaiiy develop the desired understandings. 

Second, traditional achievement measures, when used alone, are gen- 
erally inadequate for measuring cognitive learning outcomes such as 
strategic employment of reading skills. While the two traditional stan- 
dardized achievement measures employed in this study resulted in signifi- 
cant growth favoring treatment students, the nontraditional measures pro- 
vided the most direct evidence that students were indeed metacognitively 
aware of reading strategies and of their cognitive ocessing when using 
strategies. Consequently, while short studies and traditional paper-and- 
pencii measures are often adequate in instructional studies where the 
outcomes emphasize memory rather than reflection, the complexity of cogni- 
tive learning such as strategy usage demands that such instructional stu- 
dies be longer and include nontraditional measures of performance. 
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l<3Rical Implications 
Finally, this study suggests three methodological implications. 
First, it is a strong argument for naturalistic research that is conducted 
in real claSErobms where the real constraints of teaching influence the 
instructional innovation. In any other setting, one never knows whether 
the inno-i-aCion can be implemented by real teachers or not. Second, as 
noted earlier, instructional research .should be longitudinal, especially 
when the desired outcomes are cognitive understandings, because studies of 
less than an academic year In duration are less likely to capture student 
changes in strategy use. Finally, staff development is crucial in in- 
structional studies in which the innovation being studied involves more 
than proceduralized instructional routines. When the intervention focuses 
on major kinds of incision making such as those required of the teachers 
in this study, a care lly constructed staff dev. >ment model is neces- 
so ^ to ensure thac ceachers change their instr !■ 1 behavior enough to 
foster differences in stud? - outcomes. For a detailed dit : .3sion of the 
staff development iipiicatiu s, see Putnam, Roehler, and Duffy (1987). 

Future Directions 

Whereas the findings of this study are relatively conclusive, it has 
nevertheless generated six new questions about instruction. First, this 
study does not estaolish explanation as a universal feature of instruc- 
tion. If the outcome is metacognitive use of skills (as it is in the 
studies reported here), explicit verbal explanation may be quite appro- 
priate; if the outcome is affective appreciation for the aesthetics of 
literature, explicit verbal explanation may be quite inappropriate. If 
the outcome is sense making based on conscious self -monitoring of the 
text's meaning, strategic application of skills may be quite appropriate; 
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if the outcome is aatoraatlcity in instant] y recognizing^ high-frequency 
words, metacognitive approaches may be quite inappropriate. Hence, there 
is a relationship between the outcome sought and the appropriate form of 
instruction; More research needs to be conducted to determine when expla- 
nation is most appropriate. 

Second, because of the gradual way in which students' understandings 
develop, a longitudinal study of the impact of teacher explanation is 
needed. The data suggest that the effects of consistent and explicit 
explanations about the menti ■> processes involved in using skirts as strat - 
egies would be even more effec»-ive if students i. Bceived such instruction 
for longer than one academic year. 

Third, a^j iipportant a.s explicitness about me tal processing appar- 
ently is, the descrlpti""e data from this study suggest that it is not 
enougli to simply be explicit. Instead, there are qualitative dimensions 
to the instructional :.r ::eractions that occur during explanations which 
cause instruction to be .uore or less effective (Duffy & Roehler, 1986b; 
Duffy, Roehler, & Rackliffe, 1986). Additional studies must be con- 
ducted to identify these qualitative dimensions and, ultimately, to test 
te^t them but in experimental studies. 

Fourth, techniques for measuring outcomes associated with strategic 
reading must be further refined for use in future instructional studies. 
Whereas the measures of student awareness and student cogni*-ive processing 
Used in this study (sUch as the lesson interview, the concept interview, 
the Supplemental Achievement Measure, and the modified Graded Oral Reading 
Paragraph) effectively discriminated between treatment and treated control 
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students, improvements in each of these mf^asures nve necciad; ?:ecornmen- 
dations regarding these changes are provided elsewhere (Duffy, Roehler. 
et al. , 1985) . 

Fiftii, more descriptive work nee^is to bo done, regarding wnat to sav 
to students about the cognitive processing one does when applying skills 
strategically. Little information is available rep,arding the universal 
features of such reasoning or whether the idiosyncratic nature of cogni- 
tive processing precludes -^ny universal features. Consequently, there is 
curi- .-'ntly little of a specific that can be confidently included in expla- 
nacionr about mental processing. More study of the qualitative dimensions 
o' ca.-,./-- ■ .V r'ascriptions would help alleviate this problem. 

/li.al ' , interview data from participating teachers suggest that 
there is wide variation in teachers* abilities to conceptualire both 
rei 'ing as a strategic proceyj and explanation as the provision of sub- 
stantive information (Duffy & Roehler, 1986a): In a broader s'^^nse , t -se 
data suggest thr ^.eachers' perceptions of their roles as teachers ai 
influenced by contextual conditions as well as by their conceptualizations 
(Duffy, Roehler, 6c Putnam, 1987). both the teachers* conceptions and the 
instructional context have an impact on effectiveness in creating student 
outcomes. This rv3lationship needs to be explored more fully in f iture 
studies . 

Conclus ion 

This study -* s importan., for two major reasons: One is instructional 
and the other is methodological: Instructionaiiy , it establishes the 
importance of explaining mental operations. Teachers who expiicltly ex- 
plain the mental acts involved in using skiii^ strategically have more 
success with low-group students. Consequently, explanation o~ mental 
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processing is a co::ponent of 'nstruct-in vhich musr. be carefully devel 
and consciously employed. Methodologically, this s v; : iy establishes zh 
potential for studying instruction in natural settings. Instead of co 
ducting instructional studies using (a) a researcher as the teacher, 
^'b) . : net curricul'om, ^-nd (c) limited lengths of time, this study 

conducted instructional research using regular classroom teachers and 
regular mandated curriculum for the entire academic year. VThile such 
naturalistic experiments are difficult and costly, their ecological 
soundness adds a unique dimension of validity to the results. 
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Appendix A 

^ ^-^ ^ ement Princip les from the First-Grade Reading Study 

a. Teac' :des a istandard and predictable signal to get attention? 

b: Ter.cher faces class with small group while students face awa}-' 

c. Overview of what is to come is provided? 

d. New words and sounds are presented before story is read? 

e. Students repeat new sounds or words until said satisfactorily? 

f. Teacher presents information? 

g. Teacher works with inr^fviduai students as they practice? 

h. Teacher uses a pattern for turn taking? 

i. Teacher occasionally questions h student about another student's respons 

j. Teacher calls on volunteers only when personal experiences or opinions 
are related? 

k. When c ' 1 outs occur, teacher reminds the student that everyone gets a 
turn r he/she must wait? 

T . Teacher avoids leading or rhecoricai questions? 

m. Teacher provides wait time for questions? 

n. Teacher provides feedback about incorrect answer? 

o. Teacher provides! 

1. answer if answer can't be reasoned out? and 

2. clues if answer can be reasoned outT 

p. Teacher makes sure all students hear and understand correct answers? 
q. Teacher provides praise in moderation? 

r. Teacher provides specific criticism ^Lnd specification of correci: 
alternatives? 

1_ 

From L. Anders on ^ _C. Evertson, & J. Brophy: (1979). An experi- 
mental study of effective teaching in first-grade rf?ading groups. 
E lementary School Journal 79, 193 223. 
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Appendix B 
1984-85 Teach ar Expl anation Rating 
November 15, 1984 
Information Presented about the Strategy 

1. Rate how explicit the teacher is in informing students that the 
task to be learned is_a strategy for solving a problem 
encountered in reading. 

0--the teacher makes no statement about what is to be It arned 
Ccdtal absence of...). 

I' - the task is_ named/labeled but there is little inf orn... cion 
beyond "we will learn about prefixes..." 

2- -che task is named/labeled and there is some elabor^^rion beyond 

»'we will learn about prefixes..." 

3- -the t^mc is described as an adaptive, flexible st -a^egy ("we 
will learo how tc...") but it is not an exemplar. 

4- -an e>:ar'.plary presen^atipn of the task is an adaptive, flexible 

sti .r- 'V ro solve a problem encounter,:?d when reading! 



Rate how explicit the teacher is in informing students that the 
strategy is Useful as they read. 

©--there is no statement of where the skill would be used (total 
absence of . . . ) 

the tencher only mentions that the skill is generally useful 
or uselul in reading but does not specify why or when. 

2- -the usefulness of the task is related to the future ("when you 

e^t In sixth grade. or is vague or general in stating why 
or when it is related to particular text ("it helps you get 
information. . . ") 

3- -the immediate usefulness of the skill is illustrated with a 

specific reference to a particular example but it is not an 
exemplar . 

4- -an exemplary statement of the immediate usefulness of the 

skill in reading connected text in which one or more concrete 
examples are used to illustrate. 
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3. Rat^ .hoW. explicit the teacher is in telling students how to 
decide which strategy to select for use when encountering a 
problem in readig. 

0- -there is no mention that students "will have to select a 

strategy to solve the problem (total ab:5ence of...). 

1- -the teacher mentions that this skill can be ''y^"jn -r^ solve a 

problem but provides no additional i' r^-rniatto ^ 

2- -the teacher mentions that this skil ^ ; be used tc solve a 

problem and provides some information about how to choose the 
appropriate strategy. 

3- -the problem situation is explicitly specified and how to 

n'.elect an appropriate strategy is emphasized but it is not an 
exemplar . 

4- -an exemplary statement of how to recognize that problem exists 

and how to -select the appropriate strategy. 



4. Rate how explicit the teacher is in telling students how to 

perform the strategy to solve the problem when reading real texr:. 

0- -there is no explanation of how to perform the strategy (total 

absence of . . . ) . 

1- - there is an expianatlon but it is stated a^ a rule to be 

memorized or as a procedure to be recalled and no examples are 
provided. 

2- -the teacher talks about the rule arid/or procedure as routine 

to be applied without variation and examples are provider* 

3- -the teacher shows students how to follow mental steps an* 

sequence in a flexible, adaptive manner but -^.t is not an 
exemplar . 

^"^^ : ®?®'"pi^^__^®^^^^P^^^^ iri which the teacher shows students 

steps and a sequence flexibly and 
adaptively when performing the strategy. 
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II. The Means Used to Present the information 

1. Rate how explicit the teacher is in introducing the lesson. 

0- -the teacher makes no introductory statements or ovc lew 

regarding the lesson (total absence of...). 

1- -the teacher makes an introductory or overview statement about 

what is to be learned, but does not mention why or how. 

2- -the teacher makes an introductory or overview statement about 

what is to be learned and either why or how (but not both) . 

3 — the teacher makes an i .7troductory or overview statement that 
includes information about what, why and how, but it Is not ai 
exemplar. 

4- -the teacher makes an exeiflplary introductory or overview 

statement about the strategy to be learned, the "real text" 
situation in which it will be applied and what to attend to 
when using \t. 



. Rate how explicit the teacher is in modeling for students the 
mental steps in identifying the problem, selecting the strategy, 
and applying the strategy. 

0- -the teacher does not model how to do the task at any point: iu 

the lesson (total absence of...). 

1- -the teacher models procedural use of a rule. 

2- -the teacher models the steps to be followed as a procedure but 

does not make the invisible visible. 

steps in using the strategy 
adaptiveiy (makes the invisible visible) but used artificial 
text samples or otherwise is not an exemplar. 

4— the teacher provides an exemplary model of how to use mental 
steps in applying the strategy adaptiveiy to a sa.Tipie of 
natural connected text. 
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3. Rate hbvz well the teacher shifts the instructional interaction 

from teacher regualtibh of the strategy to student control of the 
strategy. 

0- -the teacher does not provide any guided practice (total 

absence of . . . ) • 

1- -the teacher requires the students to provide answers to tasks 

which presumbly call for the use of the skill (in a recitation 
or assessment mode) . 

2- -the teacher moves from teacher regulation to student 

regulation but the emphasis is on answers rather than student 
mental processing. 

3- -the teacher moves from teacher regulation to student control 

and emphasizes student mental processing rather than answers, 
but it is not an exemplar. 

4- -the teacher provides an exemplary series of_triais which are 

characterized by increased student, mental processing, but much 
teacher assistance early in the lesson, by teacher monitoring 
of students use of mental processes, and by making reference to 
the monitoring of student responses in asking for subsequent 
responses . 



4. Rate how well the teacher elicits responses which require 
students to verbalize how they arrive at their answer. 

0- -the teacher does not elicit student respbhses to the skill of 

the task (total absence of . . .) . 

1- -the teacher elicits right answers and dbes not require 

students to state hov7 they knbw the ansv/er. 

2- -the teacher requires students to state how they got answers 

but focuses on procedural recall rather than khbvzihg hbw to 
get the answer. 

3- -the teacher requires students tb explain hbvz they got the 

answer but has individual students verbalize, individual steps 
rather than having each student verbalize all the steps, or 
otherwise fail to be an exemplar. 

4- -the- teacher* s elicitations are exemplary, requiring each 

student to verbalize all the mental steps used in applying the 
skill strategically. 
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5. Pvate_how well the teacher brings closure to the observed lesson 
(or lesson segment) , 

0 'there is no evidence of closure to the lesson (total absence 
of...). 

1- -the teacher ends the lesson but makes no sumniary statement 

about the skill being taught. 

2- -the teacher makes a summary statement but does not include all 

irifdrmatibh (the what, the why and the how). 

3- -the teachier ends the lessdri with a sliminary statement about 

what was learnisd, why it was leartiecl arid how to do it (but 
does so without student involvement or otherwise fails to be 
an exemplar) . 

4- -the teacher provides exemplary closure by involving students 

iri summarizing and/or in reviewing, or in Using the skill 
strategically in natural cdnriected text, or by reminding them 
that it is in such natural connected text that the skill will 
be used. 

III. Intra- and Inter-Lesson Cohesion 



1. Rate how successful the teacher is in bringing a sense of 
cohesion to the lesson. 



G- -there is no recognizable sequence or cohesion within the 
ie sson (total absence of, . . ) . 

1- -the teacher's lesson has some evidence of a logical sequence 

but there are frequent inconsistencies and breaks: 

2- -the teacher's lesson reflects a logical progression but 

contains some inconsistencies or breaks in lesson focus or 
breaks in activity flow. 

3- -the lesson has structure, is consistent, is focused and flows 

smoothly but is not an exemplar. 

4- -the teacher provides a lesson which is exemplary in terms of 

internal structure, consistency, focus and flow. 
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2. Rate how successful the teacher is in communicating a sense of 
cohesion with past and future lessons. 

©--there is not recognizable connection to past and future 
lessons (total absence of. . .) » 

1- -the teacher refers to past lessons but makes no reference to 

future lessons or refers to future lessons but makes no 
reference to past lessons. 

2- -the teacher refers to past and future lessons but there is 

little evidence of cohesion. 

3- -the teacher refers to past and future lessons, achieves some 

cohesion across lessons, but it is no exemplar. 

4- -^he teacher provides an e.iemplary lesson in terms of its 

cohesion across lessons. 
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Rat-ing-^ upil Aw ^e^e^ss 

betermine puptl awareness by Judging pupil response to the three 
interview questions and_ail subsequent eiabdratirig probes which the 
researcher may have used in conjuction with each question. The criteria 
for pupil awareness follow. 

1. A highly rated response to the_ question about "what" was being taught 
must include a specific reference to the process involved in 
completing the task and an example: 

0- -Nb awareness (student does not know, is inaccurate or supplies 

a response that does not make sense) , 

1- -the response is a non-specific reference to the task ("We are 

learning about words.") . 

2- -the response refers tbthe name of the specifictask which can 

be done successfully if the process is applied correctly or is 
ah example of what can be done ("We are learning _ou words . ") , 

3- -the response includes a specific reference to the process being 

learned ("We are learning hbw_t6 sound out ou words^"). 

4- -the response includes a specific reference to the process and 

ah example ("We are learning how to sound out ou words, like in 
but.") . 



2. A highly rated respbhse to the question about "why" or "when it would 
be used" must specify both the context in which it will be useful and 
wh^4: he/she is able to do ih that cbhtext: 

0- -no awareness br includes hb reference to the specific task 

("I'll get smarter" br "it'll help me when I grow up."). 

1- - the response is hbt specific to the task but is related to 

reading language generally (I'll read better,."). 

2- -the respbhse refers tb ah appropriate general category but no 

to the specific use fbir what was taught ("I can sound out words 
better. ") . 

3- -the respbhse ihcludes specific reference to what he/she will be 

albel tb db but hbt the context in which it would be useful (I 
cah sbund but ou wbirds."). 

_ _ OR 

specifies the context in which it would be useful but not what 
he/she will be able to dp (I cah use this when I come upon an 
uhknbwh wbrd in my book") . 

4- -the respbhse includes both what he/she will be able to do and 

the cbhtext in which it is useful. ("When I come upon an unknown 
bUL word in my library book, 1*11 be able tb sound it out."). 



89 



Appendix C (cbht.) 



3. A highly rated response to the question about "how do you do it" must 
include an example of how one does the mental processing associated 
with successful cbirpletiori of the task of an appropriate sequence of 
steps to be followed. 

0- -no awareness. 

1- -the response is not specific to the mental processing to be 

used ("I'll sound the wbrdout."). 

OR 

is merely an example that does not illustrate conscious 
understanding of the mental processing to be used ("loud"). 

2- -the response refers to features to attend to but not to the way 

they are used in doing the mental processing ("I say, '1-ou-d'") 

3- -the_response identifies some of the features to attend to and 

some understanding of the m en^aj^^bcessing ("If I see a word 
that has ou in_it , I say the sound of ou") . 

T®^P°"_^^_^^5^°^^? ^ sequence of the mental prbcessing or a 
specific example of the mental processing (when I meet an 
unknown word such as loud , i think first... and then. .. etc .) . 



Appendix D 

Skills tested with the Supplemen ted Achievenierit: Me :i^^^ -(SAMs) 
Skylights 



Noting important details 

Decoding clusters 

Getting the main idea 
Noting correct sequence 
Muiti -reaning words 
Understanding cause & effect 
Categorising 
Commas in series _ 
Predicting outcomes 
Drawing conclusions 
Recognizing word parts 
Compound i^ords 
Recognizing base words 
2 

Towers 

Drawing cpnclusibris 
Getting the main idea 
Clusters 

Predicting outcomes 

Multi-iheaTlirig words 

Understanding cause & effect 

Compound words 

Noting correct sequence 

Categorizing 

Noting important details 
3 

Spinne rs 

Recognizing base words 
Drawing cbnclusibris 
Cbmmbri syllables- -ly, f ul , less 
Recbghizing compound words 
Nbtihg impbrtaht details 

Using cbhtext to get meaning- -familiar words 
Cohtractioris 

Using prefixes tb get word meaning 

Using cbntext tb get meaning- -unfamiliar words 

Using suffixes tb get word meaning 

Categorizing 

Getting the main idea 

Predicting outcomes 

Noting cbrrect sequence 



W.K. Durr, J.M. LePere, J. J. Pikuiski. (1983). Boston: Hbughtbh Hiffliri. 
^.K- Dorr, d.H. LePere, J.J. Pikuiski, & R.H. Brown. (1983). Boston: Hciightoh Mifflin. 
^W.K Durr, J.M. tePere, j.j. Pikuiski, & R.K. Brown. (1983). Boston: Houghton Mifflin. 
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Error Detection Test 



fiame 



Reading Teacher 
Date 



The Parade 

Mary was going downtown to wateh the parade. She skipped 
and along ran street the because she could hardly wait to get 
there. She was late so she found a good place to watch the 
parade. 

Pretty soon she could hear the music of the bands coming 
down the main street. The men of the first band dressed were 
in scarlet, with white feathers in their hats. The men of the 
second band were clad in dark blue and were playing loudly. 
They had red feathers in their caps. 

After them came the trucks loaded with dirt and cement. 
Then there were cars filled with officers and their friends. 
Mary was sad because there was no music in the parade. Next 
came a company of in soldiers dark green uniforms, hast of all 
was another band dressed in white suits and yellow feathers. 



i 

From S. Paris, D. Crosis , & M. Lipsbn (1982). Informal strategies for 

^?^^^^^S- A program to imprdve children' s reading awareness and com 
prehension. Jour nal of Educational Psy aholo^y , 76, 1239-1252. 
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Modified Graded Oral 



Reading Parajgraph (GORP) 



Note : Adapted from _W. Durr. (1983). Placement test, Houj;^hton Mifflin 
Reading Series . Boston: Houghton Mifflin. 



h earth hour fire egg c atch 

2. king pass act milk blew 

3: tQd ch form plane eight reach 

4. thick base warm tale final 

5 . port fresh trai n ' wGmen SDOon 

6. check island complete notice usual 



When Che young skunks were eigne weeks old, 
the mother skunk cook chem on their first hunt. 
It was at night. Skunks hunt at night arid sleec 
in the day. 

The young skunks follou^ed along behind their 
mother in a single line, their bushy tails held up 
high. Skunk Baby was the last in line. 

The mother skunk took her family along a path 
at the edge of the woods. She was taking them to 
Che pond in the meadow. 

The moon was shining down through che trees. 
The mother skunk stopped by a log. With her 
sharp, strong claws, she dug at the rotting wood . 
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She uncovered some small grubs and snapped 
them up. Skunk Baby tasted a fat grub and 
licked his lips . 

Suddenly the skunks heard a strange noise 
at the other end of the log. A round, bristly- 
looking animal walked past. 

The mother skunk did not even look at the 
old porcupine. She was not afraid of him. He 
was not an enemy. She gave her young a sign to 
follow her. And off the family waddled down the 
path and toward the pond. 

From the pond came the song of the frogs. 
Under rocks and leaves, crickets rubbed their 
wings together, making a cheerful, chirping; 
sound. 

The frogs' singing grew louder. The skunks 
were almost at the pond . 

Saddeniy there Wc' s a soft, swishing sound 
overhead. A great homed owl swooped dc^vn. 

The owl was a dangerous ehemiyJ The mother 
skunk stamped her front feet. Her family quickly 
scrambled under a thorny bush. 

The branches were so full of sharp thorns that 
it was impossible for the owl to land. Soon It 
hooted and flew away. 

When she was sure it was safe, the mother led 

her family to the porxi. They walked to the edge and 

drank the cool water. 
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TESTOKE 
Muiii-Mcaning Words 



Read each numbered sentence. Think about ihe 
meaning of ihe word in heavy black leriers. In one 
of ihe next two sentences, that word means the 
same as it does in the numbered sentence. Put an X 
in front of that sentence. The first one shows you how, 



^ Helen has a fish for a pet. 
■ ^ - A cat makes a good pet. 
I pst the dog on the hea 



2.' The school beD began to ring. 



X 



Did the 'telephone ring? 
I put a ring on my ringer. 



4. We made a trip to the beach. 

Don't rrip on ihi rock. 

\/ ■ _ 

^ Greg. went on a long trip 

wiin his aunt. 



1. We had our picnic in the park. 
— Park your car on this srreet. 



d. ■ • ^ The 



park is a place to play. 



3. Watch where you a.-e goi::g! 
: Did you watch TV? 
, Boris got a new waicnf 



5: Durs is the second house on the rieht. 
^ A second is a very short rime. 
Gina is the second person 
in line. 



UN'IT 5 SRiLL Ci-ic 



^^umber Correct 



From W. Durr, J. M. LePere, J.J. Pikulski, & R.H. Brovm. (1983) 
T^Qwers . Boston: Houghton Mifflin. 
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Appendix H 
Amount of Reading Measure 






m 



Studenc 

Teacher Code 

_Date 

Rosenrchcr Code 
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